Abstract:From infants to adults, each individual undergoes changes both physically and mentally through interaction with environments. These cognitive developments are usually staged, exhibited as behaviour changes and supported by neural growth and shrinking in the brain. The ultimate goal for an intelligent artificial system is to automatically build its skills in a similar way as the mental development in humans and animals, and adapt to different environments. In this paper, we present an approach to constructing robot coordination skills by developmental learning inspired by developmental psychology and neuroscience. In particular, we investigated the learning of two types of robot coordination skills: intra-modality mapping such as sensor-motor coordination of the arm; and inter-modality mapping such as eye/hand coordination. A self-organising radial basis function (RBF) network is used as the substrate to support the learning process. The RBF network grows or shrinks according to the novelty of the data obtained during the robot interaction with environment, and its parameters are adjusted by a simplified extended Kalman filter algorithm. The paper further reveals the possible biological evidence to support both the system architecture, the learning algorithm, and the adaptation of the system to its bodily changes such as in tool-use. The learning error was regarded as intrinsic motivation to drive the system to actively explore the workspace and reduce the learning errors. We tested our algorithms on a laboratory robot system with two industrial quality manipulator arms and a motorised pan/tilt head carrying a colour CCD camera. The experimental results demonstrated that the system can develop its intra-modal and inter-modal coordination skills by constructing mapping networks in a similar way as humans and animals during their early cognition development. In order to adapt to different tool sizes, the system can quickly reuse and adjust its learned knowledge in terms of the number of neurons, the size of receptive field of each neuron and the contribution from each neuron in the network. The active learning approach greatly reduces the nonuniform distribution of the learning errors.

Context-aware interaction with developmental learning mechanism for human-robot interaction

Automatic Control of Contextual Interaction Integrated with Affection and Architectural Attentional Control

Adapting Multi-Robot Behavior to Communication Atmosphere in Humans-Robots Interaction Using Fuzzy Production Rule Based Friend-Q Learning

Multi-robot behavior adaptation to local and global communication atmosphere in humans-robots interaction

Multi-Robot Behavior Adaptation to Humans' Intention in Human-Robot Interaction Using Information-Driven Fuzzy Friend-Q Learning.

Learning and Development of Home Service Robots' Service Cognition Based on a Learning Mechanism

A human-like learning approach to developmental robotic reaching

Implementation of Engagement Detection for Human–Robot Interaction in Complex Environments

Environment-adaptive learning from demonstration for proactive assistance in human–robot collaborative tasks

A Human-Like Learning Framework of Robot Interaction Skills Based on Environmental Dynamics

A Self-Organizing Developmental Cognitive Architecture with Interactive Reinforcement Learning.

The Design of Human-Robot Spatial Cognition Interaction System

A Computational Developmental Model of Perceptual Learning for Mobile Robot

Affordance Learning And Inference Based On Vision-Speech Association In Human-Robot Interactions

An AR-assisted Deep Reinforcement Learning-based approach towards mutual-cognitive safe human-robot interaction

A Developmental Approach to Robotic Pointing Via Human-Robot Interaction

Construction of Robot Intra-modal and Inter-modal Coordination Skills by Developmental Learning

An Autonomous Developmental Cognitive Architecture Based on Incremental Associative Neural Network with Dynamic Audiovisual Fusion

Skill Learning for Human-Robot Interaction Using Wearable Device

Mobile Robot’s Sensorimotor Developmental Learning from Orientation and Curiosity

A Context-Aware Safety System for Human-Robot Collaboration