Abstract:This paper proposes the implementation of fuzzy motion control based on reinforcement learning (RL) and Lagrange polynomial interpolation (LPI) for gait synthesis of biped robots. First, the procedure of a walking gait is redefined into three states, and the parameters of this designed walking gait are determined. Then, the machine learning approach applied to adjusting the walking parameters is policy gradient RL (PGRL), which can execute real-time performance and directly modify the policy without calculating the dynamic function. Given a parameterized walking motion designed for biped robots, the PGRL algorithm automatically searches the set of possible parameters and finds the fastest possible walking motion. The reward function mainly considered is first the walking speed, which can be estimated from the vision system. However, the experiment illustrates that there are some stability problems in this kind of learning process. To solve these problems, the desired zero moment point trajectory is added to the reward function. The results show that the robot not only has more stable walking but also increases its walking speed after learning. This is more effective and attractive than manual trial-and-error tuning. LPI, moreover, is employed to transform the existing motions to the motion which has a revised angle determined by the fuzzy motion controller. Then, the biped robot can continuously walk in any desired direction through this fuzzy motion control. Finally, the fuzzy-based gait synthesis control is demonstrated by tasks and point- and line-target tracking. The experiments show the feasibility and effectiveness of gait learning with PGRL and the practicability of the proposed fuzzy motion control scheme.

Gait Planning For Biped Robot Using Fuzzy Wavelet Neural Network

Gait control for biped robot using fuzzy wavelet neural network

Gait Synthesis Based on FWN for a Five-Link Biped Robot.

Gait synthesis based on FWN and PD controller for a five-link biped robot

Speed control for under-actuated planar biped robot

Time-Variant Gait Planning for Under-Actuated Biped Robot Via Optimization

Stable Biped Walking Based on Linear Search Optimization Algorithm

Optimal On-Line Walking Pattern Generation for Biped Robots

Gait Planning and Nonlinear Control of Dynamic Walking for a Five-Link,Four-Actuator,Planar Biped Robot

Human-Like Walking with Heel off and Toe Support for Biped Robot

Walking Pattern Generation of Biped Robot Using Trajectory Planning of Gravity Center

Study on Using Wavelet Neural Networks for the Gait Control of a Biped Robot

Walking motion generation, synthesis, and control for biped robot by using PGRL, LPI, and fuzzy logic

Gait Tracking Control of Biped Robot Based on Adaptive Gait Switching Algorithm

Reliable gait planning for a quadruped walking robot

3D Parametric Gait Planning of Humanoid Robot with Consideration of Comprehensive Biped Walking Constraints

Design of the 3D Gait Generator for a Novel Biped Aircushion-feet Robot.

A CPG-based gait planning and motion performance analysis for quadruped robot

Research on Walking Gait Algorithm for Biped Soccer Robot

Gait Planning and Motion Simulation of a Biped Walking Robot

Follow My Step: A Framework for Biped Robots to Imitate Human Walking