Abstract:The cerebral cortex, cerebellum, and basal ganglia play a central role in flexible learning in mammals. However, how these three structures work together is not fully understood. Recently, it has been suggested that reinforcement learning may be implemented not only in the basal ganglia but also in the cerebellum, as the activity of cerebellar climbing fibers represents reward prediction error. If the same learning mechanism via reward prediction error occurs simultaneously in the basal ganglia and cerebellum, it remains unclear how these two regions co-function. Here, we recorded neuronal activity in the output of cerebellum and basal ganglia, the cerebellar nuclei and substantia nigra pars reticulata, respectively, from ChR2 transgenic rats with high-density Neuropixels probes while optogenetically stimulating the cerebral cortex point-by-point. The temporal response patterns could be categorized into two classes in both cerebellar nuclei and substantia nigra pars reticulata. Among them, the fast excitatory response of the cerebellar nuclei due to the input of mossy fibers and the inhibitory response of the substantia nigra pars reticulata via the direct pathway were synchronized. This coincidence, reproduced in a spiking network simulation based on connectome data, was expected to synchronously activate the cerebral cortex via the thalamus. To further investigate the significance of this synchronous positive feedback, we constructed a reservoir model that mimics the time course of the activity dynamics of cerebral cortex and temporal responses of cerebellar nuclei and substantia nigra pars reticulata. Plasticity of both parallel fiber inputs to Purkinje cell and corticostriatal synapses onto the striatal neurons of the direct pathway was essential for successful learning of a reinforcement learning task. Notably, learning was inhibited when the timing of the cerebellar or basal ganglia output was delayed from the real data by 10 ms; the larger this delay, the slower the learning rate. This necessary temporal precision was observed only when the cerebral cortex operated in the β-to-γ frequency range. These results indicate that coordinated output of the cerebellum and basal ganglia, with input from the cerebral cortex in a narrow frequency band, facilitates brain-wide synergistic reinforcement learning. Thus, our findings contribute to a holistic understanding of the interactions among the cerebellum, basal ganglia, and cerebral cortex.

Cortico-cerebellar coordination facilitates neuroprosthetic control

Adenosine A2A Receptor Blockade Improves Neuroprosthetic Learning by Volitional Control of Population Calcium Signal in M1 Cortical Neurons

Neural Implementation of Precise Temporal Patterns in Motor Cortex

Mechanisms of Premotor-Motor Cortex Interactions during Goal Directed Behavior

Cortical neuroprosthesis-mediated functional ipsilateral control of locomotion in rats with spinal cord hemisection

Cerebellar Purkinje cells can differentially modulate coherence between sensory and motor cortex depending on region and behavior

Cerebellar control over inter-regional excitatory/inhibitory dynamics discriminates execution from observation of an action

Cortico-thalamic communication for action coordination in a skilled motor sequence

Volitional control of movement interacts with proprioceptive feedback in motor cortex during brain-computer interface control in humans

Back to front: cerebellar connections and interactions with the prefrontal cortex

Deconstruction of Corticospinal Circuits for Goal-Directed Motor Skills

Corticostriatal Plasticity is Necessary for Learning Intentional Neuroprosthetic Skills

The Cerebellum and Parietal Cortex Play a Specific Role in Coordination: A Pet Study

Emergence of Coordinated Neural Dynamics Underlies Neuroprosthetic Learning and Skillful Control

Disrupting cortico-cerebellar communication impairs dexterity

Cerebellar output shapes cortical preparatory activity during motor adaptation

Reconfiguring motor circuits for a joint manual and BCI task

Cerebello-Thalamic Spike Transfer via Temporal Coding and Cortical Adaptation

Synergistic reinforcement learning by cooperation of the cerebellum and basal ganglia

Concurrent Control of a Brain–computer Interface and Natural Overt Movements

Redundant information encoding in primary motor cortex during natural and prosthetic motor control