Reward-driven adaptation of movements requires strong recurrent basal ganglia-cortical loops.
The basal ganglia (BG) are a collection of subcortical nuclei involved in motor control, sensorimotor integration, and procedural learning. They play a key role in the acquisition and adaptation of movements, a process driven by dopamine-dependent plasticity at cortico-striatal projections, which serve as BG input. However, BG output is not necessary for executing many well-learned movements. This raises a fundamental question: How can plasticity at BG input contribute to the acquisition and adaptation of movements which execution does not require BG output? Existing models of BG function often neglect the feedback dynamics within cortico-BG-thalamo-cortical circuitry and do not capture the interaction between the cortex and BG in movement generation and adaptation. In this work, we address the above question in a theoretical model of the BG-thalamo-cortical multiregional network, incorporating anatomical, physiological, and behavioral evidence. We examine how its dynamics influence the execution and reward-based adaptation of reaching movements. We demonstrate how the BG-thalamo-cortical network can shape cortical motor output through the combination of three mechanisms: i) the diverse dynamics emerging from its closed-loop architecture, ii) attractor dynamics driven by recurrent cortical connections, and iii) reinforcement learning via dopamine-dependent cortico-striatal plasticity. Our study highlights the role of the cortico-BG-thalamo-cortical feedback in efficient visuomotor adaptation. It also suggests a mechanism for early-stage acquisition of reaching movements through motor babbling. More generally, our model explains how the BG-cortical network refines motor output through its intricate closed-loop dynamics and dopamine-dependent plasticity at cortico-striatal synapses.
Post-learning replay of hippocampal-striatal activity is biased by reward-prediction signals.
Neural activity encoding recent experiences is replayed during sleep and rest to promote consolidation of memories. However, precisely which features of experience influence replay prioritisation to optimise adaptive behaviour remains unclear. Here, we trained adult male rats on a novel maze-based reinforcement learning task designed to dissociate reward outcomes from reward-prediction errors. Four variations of a reinforcement learning model were fitted to the rats' behaviour over multiple days. Behaviour was best predicted by a model incorporating replay biased by reward-prediction error, compared to the same model with no replay, random replay or reward-biased replay. Neural population recordings from the hippocampus and ventral striatum of rats trained on the task evidenced preferential reactivation of reward-prediction and reward-prediction error signals during post-task rest. These insights disentangle the influences of salience on replay, suggesting that reinforcement learning is tuned by post-learning replay biased by reward-prediction error, not by reward per se. This work therefore provides a behavioural and theoretical toolkit with which to measure and interpret the neural mechanisms linking replay and reinforcement learning.
Presynaptic GABA receptors control integration of nicotinic input onto dopaminergic axons in the striatum.
Axons of dopaminergic neurons express gamma-aminobutyric acid type-A receptors (GABARs) and nicotinic acetylcholine receptors (nAChRs), which are positioned to shape striatal dopamine release. We examine how interactions between GABARs and nAChRs influence dopaminergic axon excitability. Axonal patch-clamp recordings reveal that potentiation of GABARs by benzodiazepines suppress dopaminergic axon responses to cholinergic interneuron transmission. In imaging experiments, we use the first temporal derivative of axonal calcium signals to distinguish between direct stimulation of dopaminergic axons and nAChR-evoked activity. Inhibition of GABARs with gabazine selectively enhance nAChR-evoked axonal calcium signals but does not alter the strength or dynamics of acetylcholine release, suggesting that the enhancement is mediated primarily by GABARs on dopaminergic axons. Unexpectedly, we find that a widely used GABAR antagonist, picrotoxin, inhibits axonal nAChRs and should be used cautiously for striatal circuit analysis. Overall, we demonstrate that GABARs on dopaminergic axons regulate integration of nicotinic input to shape axonal excitability.
Latest Updated Curations
Basal Ganglia Advances
Basal Ganglia Advances is a collection highlighting research on the structure, function, and disorders of the basal ganglia. It features studies spanning neuroscience, clinical insights, and computational models, serving as a hub for advances in movement, cognition, and behavior.
Progress in Voltage Imaging
Recent advances in the field of Voltage Imaging, with a special focus on new constructs and novel implementations.
Navigation & Localization
Work related to place tuning, spatial navigation, orientation and direction. Mainly includes articles on connectivity in the hippocampus, retrosplenial cortex, and related areas.
Most Popular Recent Articles
Subsecond dopamine fluctuations do not specify the vigor of ongoing actions.
Dopamine (DA) is essential for the production of vigorous actions, but how DA modifies the gain of motor commands remains unclear. Here we show that subsecond DA transients in the striatum of mice are neither required nor sufficient for specifying the vigor of ongoing forelimb movements. Our findings have important implications for our understanding of how DA contributes to motor control under physiological conditions and in Parkinson's disease.
Dopamine and serotonin cotransmission filters striatonigral synaptic activity via 5-HT1B receptor activation.
The substantia nigra pars reticulata (SNr), a key basal ganglia output nucleus, is modulated by dopamine (DA) believed to be released locally from midbrain DA neurons. Although DA has been proposed to regulate γ-aminobutyric acid (GABA) release from medium spiny neuron (MSN) terminals via presynaptic D1 receptors, the precise mechanisms remain unclear. Using presynaptic optical recordings of synaptic vesicle fusion, calcium influx in D1-MSN synapses together with postsynaptic patch-clamp recordings from SNr neurons, we found that DA inhibits D1-MSN GABA release in a frequency-dependent manner. Unexpectedly, this effect was independent of DA receptors and instead required 5-HT1B receptor activation. Using two-photon serotonin biosensor imaging in slices and fiber photometry in vivo, we demonstrate that DA enhances extracellular serotonin in the SNr via inhibition of serotonin reuptake. Our results suggest that serotonin mediates DAergic control of basal ganglia output and contributes to the therapeutic actions of dopaminergic medications for Parkinson's disease and psychostimulant-related disorders.
Neurocomputational basis of learning when choices simultaneously affect both oneself and others.
Many prosocial and antisocial behaviors simultaneously impact both ourselves and others, requiring us to learn from their joint outcomes to guide future choices. However, the neurocomputational processes supporting such social learning remain unclear. Across three pre-registered studies, participants learned how choices affected both themselves and others. Computational modeling tested whether people simulate how other people value their choices or integrate self- and other-relevant information to guide choices. An integrated value framework, rather than simulation, characterizes multi-outcome social learning. People update the expected value of choices using different types of prediction errors related to the target (e.g., self, other) and valence (e.g., positive, negative). This asymmetric value update is represented in brain regions that include ventral striatum, subgenual and pregenual anterior cingulate, insula, and amygdala. These results demonstrate that distinct encoding of self- and other-relevant information guides future social behaviors across mutually beneficial, mutually costly, altruistic, and instrumentally harmful scenarios.