Abstract:Animals possess a remarkable ability to navigate challenging terrains, achieved through the interplay of various pathways between the brain, central pattern generators (CPGs) in the spinal cord, and musculoskeletal system. Traditional bioinspired control frameworks often rely on a singular control policy that models both higher (supraspinal) and spinal cord functions. In this work, we build upon our previous research by introducing two distinct neural networks: one tasked with modulating the frequency and amplitude of CPGs to generate the basic locomotor rhythm (referred to as the spinal policy, SCP), and the other responsible for receiving environmental perception data and directly modulating the rhythmic output from the SCP to execute precise movements on challenging terrains (referred to as the descending modulation policy). This division of labor more closely mimics the hierarchical locomotor control systems observed in legged animals, thereby enhancing the robot's ability to navigate various uneven surfaces, including steps, high obstacles, and terrains with gaps. Additionally, we investigate the impact of sensorimotor delays within our framework, validating several biological assumptions about animal locomotion systems. Specifically, we demonstrate that spinal circuits play a crucial role in generating the basic locomotor rhythm, while descending pathways are essential for enabling appropriate gait modifications to accommodate uneven terrain. Notably, our findings also reveal that the multi-layered control inherent in animals exhibits remarkable robustness against time delays. Through these investigations, this paper contributes to a deeper understanding of the fundamental principles of interplay between spinal and supraspinal mechanisms in biological locomotion. It also supports the development of locomotion controllers in parallel to biological structures which are ...

Hierarchical learning control for autonomous robots inspired by central nervous system

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

Learning-based Hierarchical Control: Emulating the Central Nervous System for Bio-Inspired Legged Robot Locomotion

Meta-Reinforcement Learning of Hierarchical Fault-Tolerant Controller for Multiple Leg Failures in Hexapod Robots

Cooperative Flocking And Learning In Multi-Robot Systems For Predator Avoidance

Hierarchical Control for Bipedal Locomotion using Central Pattern Generators and Neural Networks

Hierarchical Fuzzy Behavior-Based Control Method For Autonomous Mobile Robot Navigation

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

Hierarchical Decentralized Deep Reinforcement Learning Architecture for a Simulated Four-Legged Agent

An autonomous mobile robot control method based on hierarchical fuzzy behaviors

Learning Hierarchical Control Systems for Autonomous Systems with Energy Constraints

Hierarchical Learning Control with Physical Human-Exoskeleton Interaction.

Decentralized Deep Reinforcement Learning for a Distributed and Adaptive Locomotion Controller of a Hexapod Robot

Hierarchical Robot Learning for Physical Collaboration Between Humans and Robots

Hierarchical generative modelling for autonomous robots

A Hierarchical Autonomous Robot Controller for Learning and Memory: Adaptation in a Dynamic Environment.

Agents based hierarchical control system for humanoid robots

Hierarchical motor control in mammals and machines

Hierarchical Deep Reinforcement Learning for Continuous Action Control

Autonomous Mobile Robot Control Algorithm Based on Hierarchical Fuzzy Behaviors in Unknown Environments

Design Of A Hierarchical Control System For Tetherless Snake Robot