Abstract:Legged robots that can instantly change motor patterns at different walking speeds are useful and can accomplish various tasks efficiently. However, state-of-the-art control methods either are difficult to develop or require long training times. In this study, we present a comprehensible neural control framework to integrate probability-based black-box optimization (PIBB) and supervised learning for robot motor pattern generation at various walking speeds. The control framework structure is based on a combination of a central pattern generator (CPG), a radial basis function (RBF) -based premotor network and a hypernetwork, resulting in a so-called neural CPG-RBF-hyper control network. First, the CPG-driven RBF network, acting as a complex motor pattern generator, was trained to learn policies (multiple motor patterns) for different speeds using PIBB. We also introduce an incremental learning strategy to avoid local optima. Second, the hypernetwork, which acts as a task/behavior to control parameter mapping, was trained using supervised learning. It creates a mapping between the internal CPG frequency (reflecting the walking speed) and motor behavior. This map represents the prior knowledge of the robot, which contains the optimal motor joint patterns at various CPG frequencies. Finally, when a user-defined robot walking frequency or speed is provided, the hypernetwork generates the corresponding policy for the CPG-RBF network. The result is a versatile locomotion controller which enables a quadruped robot to perform stable and robust walking at different speeds without sensory feedback. The policy of the controller was trained in the simulation (less than 1 h) and capable of transferring to a real robot. The generalization ability of the controller was demonstrated by testing the CPG frequencies that were not encountered during training.

Gait Synthesis for a Biped Robot Climbing Sloping Surfaces Using Neural Networks. II. Dynamic Learning

Gait synthesis for a biped robot climbing sloping surfaces using neural networks. I. Static learning

Learning biped locomotion based on Q-learning and neural networks

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

Gait Synthesis for the Sd-2 Biped Robot to Climb Sloping Surface

Adaptive Gait Acquisition through Learning Dynamic Stimulus Instinct of Bipedal Robot

Gait Synthesis and Sensory Control of Stair Climbing for a Humanoid Robot

Distal Learning Applied to Biped Robots

Neural network temporal quantized lagrange dynamics with cycloidal trajectory for a toe-foot bipedal robot to climb stairs

Online Gait Generation Method Based on Neural Network for Humanoid Robot Fast Walking on Uneven Terrain

Hybrid learning mechanisms under a neural control network for various walking speed generation of a quadruped robot

Study on Using Wavelet Neural Networks for the Gait Control of a Biped Robot

Environment-Centric Learning Approach for Gait Synthesis in Terrestrial Soft Robots

Gait Synthesis Based on FWN for a Five-Link Biped Robot.

Humanoid Walking Gait Optimization Using GA-Based Neural Network

Biped blind walking on changing slope with reflex control system

AN APPLICATION OF WAVELET NEURAL NETWORKS IN THE BIPED ROBOT＇S SLOPE CLIMBING

Gait Planning For Biped Robot Using Fuzzy Wavelet Neural Network

Dynamic modeling and closed-loop control design for humanoid robotic systems: Gibbs–Appell formulation and SDRE approach

Realization of a Human-like Gait for a Bipedal Robot Based on Gait Analysis