Abstract:Intelligent control of soft robots is challenging due to the nonlinear and difficult-to-model dynamics. One promising model-free approach for soft robot control is reinforcement learning (RL). However, model-free RL methods tend to be computationally expensive and data-inefficient and may not yield natural and smooth locomotion patterns for soft robots. In this work, we develop a bio-inspired design of a learning-based goal-tracking controller for a soft snake robot. The controller is composed of two modules: An RL module for learning goal-tracking behaviors given the unmodeled and stochastic dynamics of the robot, and a central pattern generator (CPG) with the Matsuoka oscillators for generating stable and diverse locomotion patterns. We theoretically investigate the maneuverability of Matsuoka CPG's oscillation bias, frequency, and amplitude for steering control, velocity control, and sim-to-real adaptation of the soft snake robot. Based on this analysis, we proposed a composition of RL and CPG modules such that the RL module regulates the tonic inputs to the CPG system given state feedback from the robot, and the output of the CPG module is then transformed into pressure inputs to pneumatic actuators of the soft snake robot. This design allows the RL agent to naturally learn to entrain the desired locomotion patterns determined by the CPG maneuverability. We validated the optimality and robustness of the control design in both simulation and real experiments, and performed extensive comparisons with state-of-art RL methods to demonstrate the benefit of our bio-inspired control design.

CPG Control Model of Snake-Like Robot Parameters of Optimization Based on GA.

Locomotion Control of a Serpentine Crawling Robot Inspired by Central Pattern Generators

Design of a MNSM-based Controller for the Swimming Motion of a Snake-Like Robot

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

Reinforcement Learning of Serpentine Locomotion for a Snake Robot

Free Gait Transition and Stable Motion Generation Using CPG-based Locomotion Control for Hexapod Robots

Steering Motion Control of a Snake Robot Via a Biomimetic Approach

Snake Robot Gait Decomposition and Gait Parameter Optimization

Learning to Locomote with Deep Neural-Network and CPG-based Control in a Soft Snake Robot

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

Cpg-Based Bio-Gait Research Of The Quadrupedal Robot

Parameters optimization of central pattern generators for hexapod robot based on multi-objective genetic algorithm

Reinforcement Learning of CPG-regulated Locomotion Controller for a Soft Snake Robot

Online Optimization of Central Pattern Generators for Quadruped Locomotion

Motion Control Of A Snake Robot Via Cerebellum-Inspired Learning Control

A General CPG Network and Its Implementation on the Microcontroller

A CPG‐Based Versatile Control Framework for Metameric Earthworm‐Like Robotic Locomotion

Cpg-Based Locomotion Control Of A Quadruped Amphibious Robot

Time-Variant Gait Planning for Under-Actuated Biped Robot Via Optimization

Bio-Inspired Multimodal Motion Gait Control of Snake Robots with Environmental Adaptability Based on ROS

Bionic Walking Control of a Biped Robot based on CPG Using an Improved Particle Swarm Algorithm