Abstract:We introduce the Self-Adaptive Goal Generation - Robust Intelligent Adaptive Curiosity (SAGG-RIAC) architecture as an intrinsi- cally motivated goal exploration mechanism which allows active learning of inverse models in high-dimensional redundant robots. This allows a robot to efficiently and actively learn distributions of parameterized motor skills/policies that solve a corresponding distribution of parameterized tasks/goals. The architecture makes the robot sample actively novel parameterized tasks in the task space, based on a measure of competence progress, each of which triggers low-level goal-directed learning of the motor policy pa- rameters that allow to solve it. For both learning and generalization, the system leverages regression techniques which allow to infer the motor policy parameters corresponding to a given novel parameterized task, and based on the previously learnt correspondences between policy and task parameters. We present experiments with high-dimensional continuous sensorimotor spaces in three different robotic setups: 1) learning the inverse kinematics in a highly-redundant robotic arm, 2) learning omnidirectional locomotion with motor primitives in a quadruped robot, 3) an arm learning to control a fishing rod with a flexible wire. We show that 1) exploration in the task space can be a lot faster than exploration in the actuator space for learning inverse models in redundant robots; 2) selecting goals maximizing competence progress creates developmental trajectories driving the robot to progressively focus on tasks of increasing complexity and is statistically significantly more efficient than selecting tasks randomly, as well as more efficient than different standard active motor babbling methods; 3) this architecture allows the robot to actively discover which parts of its task space it can learn to reach and which part it cannot.

Bidirectional interaction between visual and motor generative models using Predictive Coding and Active Inference

A Neural Active Inference Model of Perceptual-Motor Learning

Deep kinematic inference affords efficient and scalable control of bodily movements

Adaptation through prediction: multisensory active inference torque control

Active inference body perception and action for humanoid robots

Inference of Affordances and Active Motor Control in Simulated Agents

Active Predicting Coding: Brain-Inspired Reinforcement Learning for Sparse Reward Robotic Control Problems

Embodied learning of a generative neural model for biological motion perception and inference

Adaptive robot body learning and estimation through predictive coding

Active Learning of Inverse Models with Intrinsically Motivated Goal Exploration in Robots

Active Predictive Coding: A Unifying Neural Model for Active Perception, Compositional Learning, and Hierarchical Planning

Learning Generative State Space Models for Active Inference

A Novel Adaptive Controller for Robot Manipulators based on Active Inference

Active Predictive Coding: A Unified Neural Framework for Learning Hierarchical World Models for Perception and Planning

A cerebellar model for predictive motor control tested in a brain-based device

Towards Human-Like Driving: Active Inference in Autonomous Vehicle Control

Interactive inference: a multi-agent model of cooperative joint actions

Neural Circuit Architectural Priors for Embodied Control

Learning to segment self-generated from externally caused optic flow through sensorimotor mismatch circuits

Bayesian model of individual learning to control a motor imagery BCI

Learning Intuitive Physics with Multimodal Generative Models