Abstract:From infants to adults, each individual undergoes changes both physically and mentally through interaction with environments. These cognitive developments are usually staged, exhibited as behaviour changes and supported by neural growth and shrinking in the brain. The ultimate goal for an intelligent artificial system is to automatically build its skills in a similar way as the mental development in humans and animals, and adapt to different environments. In this paper, we present an approach to constructing robot coordination skills by developmental learning inspired by developmental psychology and neuroscience. In particular, we investigated the learning of two types of robot coordination skills: intra-modality mapping such as sensor-motor coordination of the arm; and inter-modality mapping such as eye/hand coordination. A self-organising radial basis function (RBF) network is used as the substrate to support the learning process. The RBF network grows or shrinks according to the novelty of the data obtained during the robot interaction with environment, and its parameters are adjusted by a simplified extended Kalman filter algorithm. The paper further reveals the possible biological evidence to support both the system architecture, the learning algorithm, and the adaptation of the system to its bodily changes such as in tool-use. The learning error was regarded as intrinsic motivation to drive the system to actively explore the workspace and reduce the learning errors. We tested our algorithms on a laboratory robot system with two industrial quality manipulator arms and a motorised pan/tilt head carrying a colour CCD camera. The experimental results demonstrated that the system can develop its intra-modal and inter-modal coordination skills by constructing mapping networks in a similar way as humans and animals during their early cognition development. In order to adapt to different tool sizes, the system can quickly reuse and adjust its learned knowledge in terms of the number of neurons, the size of receptive field of each neuron and the contribution from each neuron in the network. The active learning approach greatly reduces the nonuniform distribution of the learning errors.

Bidirectional Progressive Neural Networks With Episodic Return Progress for Emergent Task Sequencing and Robotic Skill Transfer

Bidirectional Progressive Neural Networks with Episodic Return Progress for Emergent Task Sequencing and Robotic Skill Transfer

Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

Bi-phase Episodic Memory-Guided Deep Reinforcement Learning for Robot Skills

Encoding Primitives Generation Policy Learning for Robotic Arm to Overcome Catastrophic Forgetting in Sequential Multi-Tasks Learning.

Robotic Episodic Learning and Behaviour Control Integrated with Neuron Stimulation Mechanism

Transferring Meta-Policy from Simulation to Reality via Progressive Neural Network

Modeling Long-horizon Tasks as Sequential Interaction Landscapes

Shaping Progressive Net of Reinforcement Learning for Policy Transfer with Human Evaluative Feedback

Construction of Robot Intra-modal and Inter-modal Coordination Skills by Developmental Learning

Composite dynamic movement primitives based on neural networks for human–robot skill transfer

Learning a Set of Interrelated Tasks by Using Sequences of Motor Policies for a Strategic Intrinsically Motivated Learner

PRRM: An Efficient Framework for Learning Multi-step Robotic Manipulation Tasks

Never-Ending Behavior-Cloning Agent for Robotic Manipulation

Multi-Phase Multi-Objective Dexterous Manipulation with Adaptive Hierarchical Curriculum

A neural network-based exploratory learning and motor planning system for co-robots

NeuroBCI: Multi-Brain to Multi-Robot Interaction Through EEG-Adaptive Neural Networks and Semantic Communications

Autonomous Open-Ended Learning of Tasks with Non-Stationary Interdependencies

Example-Driven Model-Based Reinforcement Learning for Solving Long-Horizon Visuomotor Tasks

Incremental Learning of Probabilistic Movement Primitives (ProMPs) for Human-Robot Cooperation

Motor-Cortex-Like Recurrent Neural Network and Multitask Learning for the Control of Musculoskeletal Systems