Abstract:From infants to adults, each individual undergoes changes both physically and mentally through interaction with environments. These cognitive developments are usually staged, exhibited as behaviour changes and supported by neural growth and shrinking in the brain. The ultimate goal for an intelligent artificial system is to automatically build its skills in a similar way as the mental development in humans and animals, and adapt to different environments. In this paper, we present an approach to constructing robot coordination skills by developmental learning inspired by developmental psychology and neuroscience. In particular, we investigated the learning of two types of robot coordination skills: intra-modality mapping such as sensor-motor coordination of the arm; and inter-modality mapping such as eye/hand coordination. A self-organising radial basis function (RBF) network is used as the substrate to support the learning process. The RBF network grows or shrinks according to the novelty of the data obtained during the robot interaction with environment, and its parameters are adjusted by a simplified extended Kalman filter algorithm. The paper further reveals the possible biological evidence to support both the system architecture, the learning algorithm, and the adaptation of the system to its bodily changes such as in tool-use. The learning error was regarded as intrinsic motivation to drive the system to actively explore the workspace and reduce the learning errors. We tested our algorithms on a laboratory robot system with two industrial quality manipulator arms and a motorised pan/tilt head carrying a colour CCD camera. The experimental results demonstrated that the system can develop its intra-modal and inter-modal coordination skills by constructing mapping networks in a similar way as humans and animals during their early cognition development. In order to adapt to different tool sizes, the system can quickly reuse and adjust its learned knowledge in terms of the number of neurons, the size of receptive field of each neuron and the contribution from each neuron in the network. The active learning approach greatly reduces the nonuniform distribution of the learning errors.

Bionic Self-Learning of Two-Wheeled Robot Based on Skinner's Operant Conditioning

Motion Control of Bionic Robots Via Biomimetic Learning

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

Balance Control of Two-Wheeled Robot Based on Reinforcement Learning.

Model Learning for Two-Wheeled Robot Self-Balance Control

Bionic Learning Strategy Applied on Snake Robot Motion Control.

Bio-robots Automatic Navigation with Graded Electric Reward Stimulation Based on Reinforcement Learning

The Control of Two-Wheeled Self-Balancing Vehicle Based on Reinforcement Learning in a Continuous Domain

Motion Control Of A Snake Robot Via Cerebellum-Inspired Learning Control

Adaptive Robotic Control Driven by a Versatile Spiking Cerebellar Network

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

Exploring unknown environments: motivated developmental learning for autonomous navigation of mobile robots

Motor Learning and Generalization Using Broad Learning Adaptive Neural Control

Control of a Humanoid NAO Robot by an Adaptive Bioinspired Cerebellar Module in 3D Motion Tasks

Agile and versatile bipedal robot tracking control through reinforcement learning

A Fully Spiking Neural Control System Based on Cerebellar Predictive Learning for Sensor-Guided Robots

Construction of Robot Intra-modal and Inter-modal Coordination Skills by Developmental Learning

High Maneuverability Control of Single-track Two-wheeled Robot in Narrow Terrain Based on Reinforcement Learning.

Learning Whole-body Motor Skills for Humanoids

Adaptive control for hindlimb locomotion in a simulated mouse through temporal cerebellar learning

Integrated model of cerebellal supervised learning and basal ganglia's reinforcement learning for mobile robot behavioral decision-making