Abstract:Background:: Quadruped crawling robots will be faced with stability problems when walking on a raised slope. The stability of robot is affected by gait planning and selection of its foothold in this terrain. The slope reaction force on anterior and posterior legs is uneven. The selection strategy of its foothold should achieve good performance for the stability of the quadruped crawling robot. background: Quadruped crawling robots will be faced with stability problems when walking on the raised slope. The stability of robot is affected by gait planning and selection of its foothold in this terrain. The slope reaction force on anterior and posterior legs is uneven. The selection strategy of its foothold should achieve good performance for the stability of quadruped crawling robot. Objective:: Aimed at the uneven problem of slope reaction force on the anterior and posterior legs of the quadruped crawling robot when walking on the raised slope, a patent method for foothold optimization using reinforcement learning based on strategy search is proposed. objective: Aimed at the uneven problem of slope reaction force on anterior and posterior legs of the quadruped crawling robot when walking on the raised slope, a reinforcement learning method based on strategy search is adopted to select its foothold for quadruped crawling robot. Methods:: The kinematic model of the quadruped crawling robot is created in D-H coordinate method. According to the gait timing sequence method, the frame description of the quadruped crawling robot's gait on the slope is proposed. The fitting polynomial coefficients and fitting curves of all joints of the leg can be obtained by using the polynomial fitting calculation method. The reinforcement learning method based on Q-learning algorithm is proposed to find the optimal foothold by interacting with the slope environment. Comparative simulation and test of other gait and climbing slope gait, the climbing slope gait with and without the Q-learning algorithm is carried out by MATLAB platform. Results:: When the quadruped crawling robot adopts the reinforcement learning method based on Qlearning algorithm to select foothold, the robot posture curves are compared without optimization strategy. The result proves that the selection strategy of its foothold is valid. Conclusion:: The selection strategy of its foothold with reinforcement learning based on Q-learning algorithm can improve the stability of the quadruped crawling robot on the raised sloped. other: not have

Practical Techniques Research on Climbing the Steep Slope of Quadruped Robots

A Switching Control Strategy For Energy Efficient Walking On Uneven Surfaces

Adaptive Locomotion Controller for a Quadruped Robot on a High-Slope Terrain

The Quadruped Robot Adaptive Control in Trotting Gait Walking on Slopes

A Balance Method for the Static Gait of a Quadruped Robot over a Slope

Unknown Slope-Oriented Research on Model Predictive Control for Quadruped Robot

Autonomous and Safety-Critical Stair Climbing Via Nonlinear Model Predictive Control for Quadrupedal Robots

Adaptive Motion Skill Learning of Quadruped Robot on Slopes Based on Augmented Random Search Algorithm

Walking Up and Down Hill with a Biologically-Inspired Postural Reflex in a Quadrupedal Robot

Compliance Control Based for a Quadruped Robot Walking over Rough Terrain

Research on Adaptive Control in Complex Terrain for Quadruped Robot

Gait Planning and Control of Quadruped Robots in Continuous Irregular Steps Environment

Modelling and Control for A Bipedal Robot on Slopes

Research on Foothold Optimization of the Quadruped Crawling Robot based on Reinforcement Learning

Stable Stair-Climbing of a Quadruped Robot

Whole-body Motion Planning and Control of a Quadruped Robot for Challenging Terrain.

Perceptive Autonomous Stair Climbing for Quadrupedal Robots

Statically balanced stair climbing gait research for a hybrid quadruped robot

Gait Planning and Compliance Control of a Biped Robot on Stairs with Desired ZMP

Research on Bionic Foot Design and Climbing Strategy of Quadruped Robot

Adaptive Walking on Slope of Quadruped Robot Based on CPG