Abstract:We introduce the Self-Adaptive Goal Generation - Robust Intelligent Adaptive Curiosity (SAGG-RIAC) architecture as an intrinsi- cally motivated goal exploration mechanism which allows active learning of inverse models in high-dimensional redundant robots. This allows a robot to efficiently and actively learn distributions of parameterized motor skills/policies that solve a corresponding distribution of parameterized tasks/goals. The architecture makes the robot sample actively novel parameterized tasks in the task space, based on a measure of competence progress, each of which triggers low-level goal-directed learning of the motor policy pa- rameters that allow to solve it. For both learning and generalization, the system leverages regression techniques which allow to infer the motor policy parameters corresponding to a given novel parameterized task, and based on the previously learnt correspondences between policy and task parameters. We present experiments with high-dimensional continuous sensorimotor spaces in three different robotic setups: 1) learning the inverse kinematics in a highly-redundant robotic arm, 2) learning omnidirectional locomotion with motor primitives in a quadruped robot, 3) an arm learning to control a fishing rod with a flexible wire. We show that 1) exploration in the task space can be a lot faster than exploration in the actuator space for learning inverse models in redundant robots; 2) selecting goals maximizing competence progress creates developmental trajectories driving the robot to progressively focus on tasks of increasing complexity and is statistically significantly more efficient than selecting tasks randomly, as well as more efficient than different standard active motor babbling methods; 3) this architecture allows the robot to actively discover which parts of its task space it can learn to reach and which part it cannot.

Unsupervised Learning of Goal Spaces for Intrinsically Motivated Goal Exploration

Active Learning of Inverse Models with Intrinsically Motivated Goal Exploration in Robots

Autonomous Scene Exploration Using Experience Enhancement

Breadcrumbs to the Goal: Goal-Conditioned Exploration from Human-in-the-Loop Feedback

End-to-End Autonomous Exploration with Deep Reinforcement Learning and Intrinsic Motivation

Unsupervised Control Through Non-Parametric Discriminative Rewards

CURIOUS: Intrinsically Motivated Modular Multi-Goal Reinforcement Learning

Autotelic Agents with Intrinsically Motivated Goal-Conditioned Reinforcement Learning: A Short Survey

Intrinsic Motivation and Episodic Memories for Robot Exploration of High-Dimensional Sensory Spaces

Unsupervised Visuomotor Control through Distributional Planning Networks

Language Grounding through Social Interactions and Curiosity-Driven Multi-Goal Learning

Learning to explore by reinforcement over high-level options

Planning Goals for Exploration

Object Goal Navigation using Goal-Oriented Semantic Exploration

Learning Exploration Policies for Navigation

Autonomous discovery of the goal space to learn a parameterized skill

Intrinsically Motivated Acquisition of Modular Slow Features for Humanoids in Continuous and Non-Stationary Environments

A target-driven visual navigation method based on intrinsic motivation exploration and space topological cognition

Unsupervised Learning of Effective Actions in Robotics

Developmental Reinforcement Learning Through Sensorimotor Space Enlargement

Unsupervised Learning of Visual 3D Keypoints for Control