Abstract:Legged robots that can instantly change motor patterns at different walking speeds are useful and can accomplish various tasks efficiently. However, state-of-the-art control methods either are difficult to develop or require long training times. In this study, we present a comprehensible neural control framework to integrate probability-based black-box optimization (PIBB) and supervised learning for robot motor pattern generation at various walking speeds. The control framework structure is based on a combination of a central pattern generator (CPG), a radial basis function (RBF) -based premotor network and a hypernetwork, resulting in a so-called neural CPG-RBF-hyper control network. First, the CPG-driven RBF network, acting as a complex motor pattern generator, was trained to learn policies (multiple motor patterns) for different speeds using PIBB. We also introduce an incremental learning strategy to avoid local optima. Second, the hypernetwork, which acts as a task/behavior to control parameter mapping, was trained using supervised learning. It creates a mapping between the internal CPG frequency (reflecting the walking speed) and motor behavior. This map represents the prior knowledge of the robot, which contains the optimal motor joint patterns at various CPG frequencies. Finally, when a user-defined robot walking frequency or speed is provided, the hypernetwork generates the corresponding policy for the CPG-RBF network. The result is a versatile locomotion controller which enables a quadruped robot to perform stable and robust walking at different speeds without sensory feedback. The policy of the controller was trained in the simulation (less than 1 h) and capable of transferring to a real robot. The generalization ability of the controller was demonstrated by testing the CPG frequencies that were not encountered during training.

Gait synthesis for a biped robot climbing sloping surfaces using neural networks. I. Static learning

Gait Synthesis for a Biped Robot Climbing Sloping Surfaces Using Neural Networks. II. Dynamic Learning

Learning biped locomotion based on Q-learning and neural networks

Motion Modeling for Humanoid Robot Walking on Slopes

Gait Synthesis for the Sd-2 Biped Robot to Climb Sloping Surface

Gait Synthesis and Sensory Control of Stair Climbing for a Humanoid Robot

Neural network temporal quantized lagrange dynamics with cycloidal trajectory for a toe-foot bipedal robot to climb stairs

Adaptive Gait Acquisition through Learning Dynamic Stimulus Instinct of Bipedal Robot

Environment-Centric Learning Approach for Gait Synthesis in Terrestrial Soft Robots

Study on Using Wavelet Neural Networks for the Gait Control of a Biped Robot

Online Gait Generation Method Based on Neural Network for Humanoid Robot Fast Walking on Uneven Terrain

Distal Learning Applied to Biped Robots

Online Learning of Uneven Terrain for Humanoid Bipedal Walking

Dynamic modeling and closed-loop control design for humanoid robotic systems: Gibbs–Appell formulation and SDRE approach

Synthetic 3D full-body skeletal motion from 2D paths using RNN with LSTM cells and linear networks

AN APPLICATION OF WAVELET NEURAL NETWORKS IN THE BIPED ROBOT＇S SLOPE CLIMBING

Gait Synthesis Based on FWN for a Five-Link Biped Robot.

Cycloidal Trajectory Realization on Staircase based on Neural Network Temporal Quantized Lagrange Dynamics (NNTQLD) with Ant Colony Optimization for a 9-Link Bipedal Robot

Realization of a Human-like Gait for a Bipedal Robot Based on Gait Analysis

Biped blind walking on changing slope with reflex control system

Hybrid learning mechanisms under a neural control network for various walking speed generation of a quadruped robot