Publication
Dopamine Dynamics in Reward-based Learning
Related concepts (34)
Dopamine
Dopamine (DA, a contraction of 3,4-dihydroxyphenethylamine) is a neuromodulatory molecule that plays several important roles in cells. It is an organic chemical of the catecholamine and phenethylamine families. Dopamine constitutes about 80% of the catecholamine content in the brain. It is an amine synthesized by removing a carboxyl group from a molecule of its precursor chemical, L-DOPA, which is synthesized in the brain and kidneys. Dopamine is also synthesized in plants and most animals.
Reward system
The reward system (the mesocorticolimbic circuit) is a group of neural structures responsible for incentive salience (i.e., "wanting"; desire or craving for a reward and motivation), associative learning (primarily positive reinforcement and classical conditioning), and positively-valenced emotions, particularly ones involving pleasure as a core component (e.g., joy, euphoria and ecstasy). Reward is the attractive and motivational property of a stimulus that induces appetitive behavior, also known as approach behavior, and consummatory behavior.
Dopamine receptor
Dopamine receptors are a class of G protein-coupled receptors that are prominent in the vertebrate central nervous system (CNS). Dopamine receptors activate different effectors through not only G-protein coupling, but also signaling through different protein (dopamine receptor-interacting proteins) interactions. The neurotransmitter dopamine is the primary endogenous ligand for dopamine receptors. Dopamine receptors are implicated in many neurological processes, including motivational and incentive salience, cognition, memory, learning, and fine motor control, as well as modulation of neuroendocrine signaling.
Nucleus accumbens
The nucleus accumbens (NAc or NAcc; also known as the accumbens nucleus, or formerly as the nucleus accumbens septi, Latin for "nucleus adjacent to the septum") is a region in the basal forebrain rostral to the preoptic area of the hypothalamus. The nucleus accumbens and the olfactory tubercle collectively form the ventral striatum. The ventral striatum and dorsal striatum collectively form the striatum, which is the main component of the basal ganglia.
Dopamine hypothesis of schizophrenia
The dopamine hypothesis of schizophrenia or the dopamine hypothesis of psychosis is a model that attributes the positive symptoms of schizophrenia to a disturbed and hyperactive dopaminergic signal transduction. The model draws evidence from the observation that a large number of antipsychotics have dopamine-receptor antagonistic effects. The theory, however, does not posit dopamine overabundance as a complete explanation for schizophrenia.
Neurotransmitter
A neurotransmitter is a signaling molecule secreted by a neuron to affect another cell across a synapse. The cell receiving the signal, or target cell, may be another neuron, but could also be a gland or muscle cell. Neurotransmitters are released from synaptic vesicles into the synaptic cleft where they are able to interact with neurotransmitter receptors on the target cell. The neurotransmitter's effect on the target cell is determined by the receptor it binds to.
Synaptic plasticity
In neuroscience, synaptic plasticity is the ability of synapses to strengthen or weaken over time, in response to increases or decreases in their activity. Since memories are postulated to be represented by vastly interconnected neural circuits in the brain, synaptic plasticity is one of the important neurochemical foundations of learning and memory (see Hebbian theory). Plastic change often results from the alteration of the number of neurotransmitter receptors located on a synapse.
Addiction
Addiction is generally a neuropsychological disorder defining pervasive and intense urge to engage in maladaptive behaviors providing immediate sensory rewards (e.g. consuming drugs, excessively gambling), despite their harmful consequences. Dependence is generally an addiction that can involve withdrawal issues. Addictive disorder is a category of mental disorders defining important intensities of addictions or dependences, which induce functional disabilities. There are no agreed definitions on these terms – see section on 'definitions'.
Reinforcement learning
Reinforcement learning (RL) is an area of machine learning concerned with how intelligent agents ought to take actions in an environment in order to maximize the notion of cumulative reward. Reinforcement learning is one of three basic machine learning paradigms, alongside supervised learning and unsupervised learning. Reinforcement learning differs from supervised learning in not needing labelled input/output pairs to be presented, and in not needing sub-optimal actions to be explicitly corrected.
Basal ganglia
The basal ganglia (BG), or basal nuclei, are a group of subcortical nuclei, of varied origin, in the brains of vertebrates. In humans, and some primates, there are some differences, mainly in the division of the globus pallidus into an external and internal region, and in the division of the striatum. The basal ganglia are situated at the base of the forebrain and top of the midbrain. Basal ganglia are strongly interconnected with the cerebral cortex, thalamus, and brainstem, as well as several other brain areas.