Abstract:Background:: Quadruped crawling robots will be faced with stability problems when walking on a raised slope. The stability of robot is affected by gait planning and selection of its foothold in this terrain. The slope reaction force on anterior and posterior legs is uneven. The selection strategy of its foothold should achieve good performance for the stability of the quadruped crawling robot. background: Quadruped crawling robots will be faced with stability problems when walking on the raised slope. The stability of robot is affected by gait planning and selection of its foothold in this terrain. The slope reaction force on anterior and posterior legs is uneven. The selection strategy of its foothold should achieve good performance for the stability of quadruped crawling robot. Objective:: Aimed at the uneven problem of slope reaction force on the anterior and posterior legs of the quadruped crawling robot when walking on the raised slope, a patent method for foothold optimization using reinforcement learning based on strategy search is proposed. objective: Aimed at the uneven problem of slope reaction force on anterior and posterior legs of the quadruped crawling robot when walking on the raised slope, a reinforcement learning method based on strategy search is adopted to select its foothold for quadruped crawling robot. Methods:: The kinematic model of the quadruped crawling robot is created in D-H coordinate method. According to the gait timing sequence method, the frame description of the quadruped crawling robot's gait on the slope is proposed. The fitting polynomial coefficients and fitting curves of all joints of the leg can be obtained by using the polynomial fitting calculation method. The reinforcement learning method based on Q-learning algorithm is proposed to find the optimal foothold by interacting with the slope environment. Comparative simulation and test of other gait and climbing slope gait, the climbing slope gait with and without the Q-learning algorithm is carried out by MATLAB platform. Results:: When the quadruped crawling robot adopts the reinforcement learning method based on Qlearning algorithm to select foothold, the robot posture curves are compared without optimization strategy. The result proves that the selection strategy of its foothold is valid. Conclusion:: The selection strategy of its foothold with reinforcement learning based on Q-learning algorithm can improve the stability of the quadruped crawling robot on the raised sloped. other: not have

Adaptive Motion Skill Learning of Quadruped Robot on Slopes Based on Augmented Random Search Algorithm

Motion Modeling for Humanoid Robot Walking on Slopes

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Adaptive Locomotion Controller for a Quadruped Robot on a High-Slope Terrain

The Quadruped Robot Adaptive Control in Trotting Gait Walking on Slopes

Unknown Slope-Oriented Research on Model Predictive Control for Quadruped Robot

Adaptive Walking on Slope of Quadruped Robot Based on CPG

Modelling and Control for A Bipedal Robot on Slopes

Research on Foothold Optimization of the Quadruped Crawling Robot based on Reinforcement Learning

A Balance Method for the Static Gait of a Quadruped Robot over a Slope

Gait Planning and Control of Quadruped Robots in Continuous Irregular Steps Environment

Real-time Replanning and Control of Quadruped Robots for Blind Locomotion on Uneven Terrain

Walking Stabilization Control for Humanoid Robots on Unknown Slope Based on Walking Sequences Adjustment

Walking Simulation of Biped Robot on Inclined Plane Based on Gait Recognition

Research on Adaptive Control in Complex Terrain for Quadruped Robot

Sequential sensor fusion-based W-DDPG gait controller of bipedal robots for adaptive slope walking

Multi-objective Optimization for a Humanoid Robot Walking on Slopes

Practical Techniques Research on Climbing the Steep Slope of Quadruped Robots

Static Gait Planning Method for Quadruped Robot Walking on Unknown Rough Terrain.

A Novel Control Strategy for Quadruped Robot Walking over Irregular Terrain

Adaptive Walking Control of Quadruped Robots Based on Central Pattern Generator （CPG） and Reflex