Abstract:The cerebellum is known to be intimately involved in motor control and learning. The most distinctive characteristics of the cerebellum is its anatomically well-defined uniform neuronal circuitry over the cerebellar cortex and the physiologically identified synaptic plasticity driven by ultra-low firing climbing fiber input to Purkinje cells [1]. To date, realistic spiking neuron models and more abstract neural network models of the cerebellum have been constructed to argue roles of each neuron type, namely granular (Gr), Golgi (Go), basket (Ba), stellate (St), and Purkinje (Pk) cells that form the uniform cerebellar cortical neuronal circuitry [2]. However not much attention has been made on the bi-hemispheric structure of the cerebellum in relation to the ultra-low firing climbing fiber input [3]. Here we configured a cerebellar neuronal network model consisting of two hemispheres that have the identical anatomically plausible connections of each neuron type. One and only difference between the models of the two hemispheres is in their climbing fiber input. For example, the amplitude of the climbing fiber input to the right cerebellum increases with behavioral errors in one direction while that to the left cerebellum simultaneously decreases only slightly and is clipped at zero due to the ultra-low firing rate. In this way, even we implemented the identical synaptic plasticity (LTP and LTD) at Gr and Pk cells for the left and right hemisphere models, their output (Pk cell activities) would result in asymmetry. We determined the number of each neuron type as follows so that the model can run in real time and be applied to adaptive control of an unstable robot: 755 Gr, 5 Go, 5 Ba/St, 1Pk in each hemisphere. We chose a 2-wheeled unstable robot (e-nuvo, ZMP) that naturally shows asymmetry in its forward and backward motion. A common feedback controller (PD) was used in parallel with the cerebellar model to employ the feedback error learning scheme in which the model induces the synaptic plasticity to reduce the output of the PD. In real world testing, the proposed model was able to control the robot to follow a single sinusoidal trajectory (0.1 Hz), and also managed to compensate for an abrupt imposition of extra-weight placed either on-centered (balance load) or off-centered (unbalance load) on the robot body. During this adaptive process, the bi-hemispheric cerebellar model gradually took over the contribution of the PD controller by modifying their adaptive synaptic weights so that each hemisphere can optimize the forward and backward motion of the robot. Furthermore, we tested the controller lacking the realistic cf input using a learning rule without considering the ultra-low spontaneous dc firing. Even in such a case, the proposed controller successfully compensated for the balanced or the unbalanced load initially, however, it became gradually unstable as the experiment continued. These results suggest that the bi-hemispheric cerebellar structure may play a role in directionally asymmetrical motor control and learning, while the cf spontaneous activity may serve for stabilization of motor learning.

Thalamic Cooperation Between the Cerebellum and Basal Ganglia with a New Tropism-Based Action-Dependent Heuristic Dynamic Programming Method.

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

A Simplified Cerebellar Model with Priority-based Delayed Eligibility Trace Learning for Motor Control

Motion Control of Bionic Robots Via Biomimetic Learning

Motor Learning Based on the Cooperation of Cerebellum and Basal Ganglia for a Self-Balancing Two-Wheeled Robot

Behavior Cognition Computational ModelBased on Cerebellum and Basal Ganglia Mechanism

A Simplified Cerebellum-Based Model for Motor Control in Brain Based Devices.

Construction of a bi-hemispheric cerebellar neuronal network model with realistic climbing fiber input and its application to adaptive control of an unstable robot

A Goal-Directed Behavioral Learning Model Based on Hippocampal-Striatal Circuit

A Bio-Inspired Integration Model of Basal Ganglia and Cerebellum for Motion Learning of a Musculoskeletal Robot

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

Integrated model of cerebellal supervised learning and basal ganglia's reinforcement learning for mobile robot behavioral decision-making

Adaptive Robotic Control Driven by a Versatile Spiking Cerebellar Network

Hierarchical Control for Bipedal Locomotion using Central Pattern Generators and Neural Networks

Learning-based Hierarchical Control: Emulating the Central Nervous System for Bio-Inspired Legged Robot Locomotion

On-line NNAC for a Balancing Two-Wheeled Robot Using Feedback-Error-Learning on the Neurophysiological Mechanism.

Learning to Balance While Reaching: A Cerebellar-Based Control Architecture for a Self-balancing Robot

A Neurorobotic Embodiment for Exploring the Dynamical Interactions of a Spiking Cerebellar Model and a Robot Arm During Vision-based Manipulation Tasks

A Cerebellum-Inspired Learning Approach for Adaptive and Anticipatory Control

A Cerebellum-Inspired Network Model and Learning Approaches for Solving Kinematic Tracking Control of Redundant Manipulators

Control of a Humanoid NAO Robot by an Adaptive Bioinspired Cerebellar Module in 3D Motion Tasks