Abstract:For path following of snake robots, many model-based controllers have demonstrated strong tracking abilities. However, a satisfactory performance often relies on precise modelling and simplified assumptions. In addition, visual perception is also essential for autonomous closed-loop control, which renders the path following of snake robots even more challenging. Hence, a novel reinforcement learning-based hierarchical control framework is designed to enable a snake robot with an onboard camera to realize autonomous self-localization and path following. Specifically, firstly, a path following policy is trained in a hierarchical manner, in which the RL algorithm and gait knowledge are well combined. On this basis, the training efficiency is sufficiently optimized, and the path following performance of the control policy is greatly improved, which can then be implemented on a practical snake robot without any additional training. Subsequently, in order to promote visual self-localization during path following, a visual localization stabilization item is added to the reward function that trains the path following strategy, which endows a snake robot with smooth steering ability during locomotion, thereby guaranteeing the accuracy of visual localization and facilitating practical applications. Comparative simulations and experimental results are illustrated to exhibit the superior performance of the proposed hierarchical path following the control method in terms of convergence speed and tracking accuracy.

Path Following of the Rope-Drive Snake-Like Robot

Structural Design and Motion Mechanism of the Rope-Drive Snake-Like Robot

Dual-Loop Control of Cable-Driven Snake-like Robots

Anti-disturbance path-following control for snake robots with spiral motion

Dexterous obstacle-avoidance motion control of Rope Driven Snake Manipulator based on the bionic path following

Design and Control of a Snake Arm Robot

Design and research of a new structure rescue snake robot with all body drive system

Confined Spaces Path Following for Cable-Driven Snake Robots with Prediction Lookup and Interpolation Algorithms

Structural Analysis and Design of Round Belt Drive Snake-Like Robot

Steering Motion Control of a Snake Robot Via a Biomimetic Approach

Direction Control and Adaptive Path Following of 3-D Snake-Like Robot Motion

Design and Development of a Snake Robot with Wheeled Modules

An overview on theory and implementation of snake-like robots

Analysis and Optimization Based on Factors Affecting the Spiral Climbing Locomotion of Snake-like Robot

Leader-follower Method-Based Formation Control for Snake Robots

Adaptive Path Following and Locomotion Optimization of Snake-Like Robot Controlled by the Central Pattern Generator

Gait Design of a Novel Arboreal Concertina Locomotion for Snake-like Robots

Real-Time Whole-Body Collision Avoidance and Path Following of a Snake Robot Through MPC-based Optimization Strategies

A Reinforcement Learning-Based Strategy of Path Following for Snake Robots with an Onboard Camera

Target Tracking of Snake Robot with Double-Sine Serpentine Gait Based on Adaptive Sliding Mode Control

Towards Autonomous Locomotion: Slithering Gait Design of a Snake-Like Robot for Target Observation and Tracking