Abstract:Legged robots that can instantly change motor patterns at different walking speeds are useful and can accomplish various tasks efficiently. However, state-of-the-art control methods either are difficult to develop or require long training times. In this study, we present a comprehensible neural control framework to integrate probability-based black-box optimization (PIBB) and supervised learning for robot motor pattern generation at various walking speeds. The control framework structure is based on a combination of a central pattern generator (CPG), a radial basis function (RBF) -based premotor network and a hypernetwork, resulting in a so-called neural CPG-RBF-hyper control network. First, the CPG-driven RBF network, acting as a complex motor pattern generator, was trained to learn policies (multiple motor patterns) for different speeds using PIBB. We also introduce an incremental learning strategy to avoid local optima. Second, the hypernetwork, which acts as a task/behavior to control parameter mapping, was trained using supervised learning. It creates a mapping between the internal CPG frequency (reflecting the walking speed) and motor behavior. This map represents the prior knowledge of the robot, which contains the optimal motor joint patterns at various CPG frequencies. Finally, when a user-defined robot walking frequency or speed is provided, the hypernetwork generates the corresponding policy for the CPG-RBF network. The result is a versatile locomotion controller which enables a quadruped robot to perform stable and robust walking at different speeds without sensory feedback. The policy of the controller was trained in the simulation (less than 1 h) and capable of transferring to a real robot. The generalization ability of the controller was demonstrated by testing the CPG frequencies that were not encountered during training.

High-speed quadrupedal locomotion by imitation-relaxation reinforcement learning

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Learning Agile, Robust Locomotion Skills for Quadruped Robot.

Learning Quadrupedal High-Speed Running on Uneven Terrain

Robust High-speed Running for Quadruped Robots via Deep Reinforcement Learning

Learning Fast and Agile Quadrupedal Locomotion over Complex Terrain

Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response

Hybrid learning mechanisms under a neural control network for various walking speed generation of a quadruped robot

Running Gait and Control of Quadruped Robot Based on SLIP Model

Bio-Inspired Rhythmic Locomotion for Quadruped Robots

Economical Quadrupedal Multi-Gait Locomotion via Gait-Heuristic Reinforcement Learning

Quadrupedal Locomotion in an Energy-efficient Way Based on Reinforcement Learning

Impedance Matching: Enabling an RL-Based Running Jump in a Quadruped Robot

RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotion

Optimal Gait Control for a Tendon-driven Soft Quadruped Robot by Model-based Reinforcement Learning

Imitating and Finetuning Model Predictive Control for Robust and Symmetric Quadrupedal Locomotion

Learning Robust, Agile, Natural Legged Locomotion Skills in the Wild

Combining model-predictive control and predictive reinforcement learning for stable quadrupedal robot locomotion

Optimal Time Control of Quadruped Robot Diagonal Gait Based on Half-Robot Model

Control of a Quadruped Robot with Bionic Springy Legs in Trotting Gait

Animal-Like Eye Vision Assisted Locomotion of a Quadruped Based on Reinforcement Learning.