Abstract:Quadruped animal locomotion emerges from the interactions between the spinal central pattern generator (CPG), sensory feedback, and supraspinal drive signals from the brain. Computational models of CPGs have been widely used for investigating the spinal cord contribution to animal locomotion control in computational neuroscience and in bio-inspired robotics. However, the contribution of supraspinal drive to anticipatory behavior, i.e. motor behavior that involves planning ahead of time (e.g. of footstep placements), is not yet properly understood. In particular, it is not clear whether the brain modulates CPG activity and/or directly modulates muscle activity (hence bypassing the CPG) for accurate foot placements. In this paper, we investigate the interaction of supraspinal drive and a CPG in an anticipatory locomotion scenario that involves stepping over gaps. By employing deep reinforcement learning (DRL), we train a neural network policy that replicates the supraspinal drive behavior. This policy can either modulate the CPG dynamics, or directly change actuation signals to bypass the CPG dynamics. Our results indicate that the direct supraspinal contribution to the actuation signal is a key component for a high gap crossing success rate. However, the CPG dynamics in the spinal cord are beneficial for gait smoothness and energy efficiency. Moreover, our investigation shows that sensing the front feet distances to the gap is the most important and sufficient sensory information for learning gap crossing. Our results support the biological hypothesis that cats and horses mainly control the front legs for obstacle avoidance, and that hind limbs follow an internal memory based on the front limbs' information. Our method enables the quadruped robot to cross gaps of up to 20 cm (50% of body-length) without any explicit dynamics modeling or Model Predictive Control (MPC).

DeepTransition: Viability Leads to the Emergence of Gait Transitions in Learning Anticipatory Quadrupedal Locomotion Skills

Viability leads to the emergence of gait transitions in learning agile quadrupedal locomotion on challenging terrains

Free Gait Transition and Stable Motion Generation Using CPG-based Locomotion Control for Hexapod Robots

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Stability and Agility: Biped Running over Varied and Unknown Terrain

Bio-inspired Gait Transitions for Quadruped Locomotion

Economical Quadrupedal Multi-Gait Locomotion via Gait-Heuristic Reinforcement Learning

A Novel Multi-Gait Strategy for Stable and Efficient Quadruped Robot Locomotion

AllGaits: Learning All Quadruped Gaits and Transitions

Puppeteer and Marionette: Learning Anticipatory Quadrupedal Locomotion Based on Interactions of a Central Pattern Generator and Supraspinal Drive

Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robots

Research On Smooth Trot-To-Walk Gait Transition Algorithm For Quadruped Robot

Learning Free Gait Transition for Quadruped Robots via Phase-Guided Controller

Gait Transition for a Quadrupedal Robot by Replacing the Gait Matrix of a Central Pattern Generator Model.

Fast and Efficient Locomotion via Learned Gait Transitions

Autonomous Locomotion Mode Transition in Quadruped Track-Legged Robots: A Simulation-Based Analysis for Step Negotiation

Gaitor: Learning a Unified Representation Across Gaits for Real-World Quadruped Locomotion

Adaptive Energy Regularization for Autonomous Gait Transition and Energy-Efficient Quadruped Locomotion

A gait generation and transition method for quadruped walking machine

A gait generating algorithm with smooth speed transition for the locomotion of legged robots