Abstract:Humans can produce complex whole-body motions when interacting with their surroundings, by planning, executing and combining individual limb movements. We investigated this fundamental aspect of motor control in the setting of autonomous robotic operations. We approach this problem by hierarchical generative modelling equipped with multi-level planning-for autonomous task completion-that mimics the deep temporal architecture of human motor control. Here, temporal depth refers to the nested time scales at which successive levels of a forward or generative model unfold, for example, delivering an object requires a global plan to contextualise the fast coordination of multiple local movements of limbs. This separation of temporal scales also motivates robotics and control. Specifically, to achieve versatile sensorimotor control, it is advantageous to hierarchically structure the planning and low-level motor control of individual limbs. We use numerical and physical simulation to conduct experiments and to establish the efficacy of this formulation. Using a hierarchical generative model, we show how a humanoid robot can autonomously complete a complex task that necessitates a holistic use of locomotion, manipulation, and grasping. Specifically, we demonstrate the ability of a humanoid robot that can retrieve and transport a box, open and walk through a door to reach the destination, approach and kick a football, while showing robust performance in presence of body damage and ground irregularities. Our findings demonstrated the effectiveness of using human-inspired motor control algorithms, and our method provides a viable hierarchical architecture for the autonomous completion of challenging goal-directed tasks.

Autonomously Achieving Bipedal Locomotion Skill Via Hierarchical Motion Modelling.

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Hierarchical Learning Framework for Whole-Body Model Predictive Control of a Real Humanoid Robot

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

A Multi-Stage Approach for Efficiently Learning Humanoid Robot Stand-Up Behavior

Learning and Reusing Quadruped Robot Movement Skills from Biological Dogs for Higher-Level Tasks

Learning Responsive Humanoid Motion Skills from Graph-Powered Motion Matching

Hierarchical generative modelling for autonomous robots

CPG-Based Hierarchical Locomotion Control for Modular Quadrupedal Robots Using Deep Reinforcement Learning.

Active online learning of the bipedal walking

Dynamic Movement Primitives Based Robot Skills Learning

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation

Hierarchical Dynamic Movement Primitive for the Smooth Movement of Robots Based on Deep Reinforcement Learning

HYPERmotion: Learning Hybrid Behavior Planning for Autonomous Loco-manipulation

Learning Whole-body Motor Skills for Humanoids

Hybrid Bipedal Locomotion Based on Reinforcement Learning and Heuristics

Learning Generic and Dynamic Locomotion of Humanoids Across Discrete Terrains

A Hierarchical Framework for Quadruped Locomotion Based on Reinforcement Learning

Modeling and reinforcement learning-based locomotion control for a humanoid robot with kinematic loop closures

MorAL: Learning Morphologically Adaptive Locomotion Controller for Quadrupedal Robots on Challenging Terrains