Abstract:This paper proposes the implementation of fuzzy motion control based on reinforcement learning (RL) and Lagrange polynomial interpolation (LPI) for gait synthesis of biped robots. First, the procedure of a walking gait is redefined into three states, and the parameters of this designed walking gait are determined. Then, the machine learning approach applied to adjusting the walking parameters is policy gradient RL (PGRL), which can execute real-time performance and directly modify the policy without calculating the dynamic function. Given a parameterized walking motion designed for biped robots, the PGRL algorithm automatically searches the set of possible parameters and finds the fastest possible walking motion. The reward function mainly considered is first the walking speed, which can be estimated from the vision system. However, the experiment illustrates that there are some stability problems in this kind of learning process. To solve these problems, the desired zero moment point trajectory is added to the reward function. The results show that the robot not only has more stable walking but also increases its walking speed after learning. This is more effective and attractive than manual trial-and-error tuning. LPI, moreover, is employed to transform the existing motions to the motion which has a revised angle determined by the fuzzy motion controller. Then, the biped robot can continuously walk in any desired direction through this fuzzy motion control. Finally, the fuzzy-based gait synthesis control is demonstrated by tasks and point- and line-target tracking. The experiments show the feasibility and effectiveness of gait learning with PGRL and the practicability of the proposed fuzzy motion control scheme.

Estimating Biped Gait Using Spline-Based Probability Distribution Function with Q-Learning.

Estimating Probability Distribution with Q-learning for Biped Gait Generation and Optimization.

Biped Gait Optimization Using Spline Function Based Probability Model.

Biped Gait Optimization Using Estimation of Distribution Algorithm.

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Learning biped locomotion based on Q-learning and neural networks

Optimal On-Line Walking Pattern Generation for Biped Robots

Gait Optimization and Energy-Based Stability for Biped Locomotion Using Large-Scale Programming

Gait Planning of Quadruped Robot Based on Third-Order Spline Interpolation.

A Unified Motion Generation Approach for Quadruped L-S Walk and Trot Gaits Based on Linear Model Predictive Control

Free Gait Generation of Quadruped Robots Via Impulse-Based Feasibility Analysis

Distal Learning Applied to Biped Robots

C-SQG: Cosine-Law-Based Spatially Quantized Gait Generation for Knee-stretched Biped Walking

Walking motion generation, synthesis, and control for biped robot by using PGRL, LPI, and fuzzy logic

Walking Pattern Generation Using Quintic Spline Function Based on Human Motion Capture

Model Predictive Control for Motion Planning of Quadrupedal Locomotion.

Adaptive Gait Acquisition through Learning Dynamic Stimulus Instinct of Bipedal Robot

Real-time Walking Pattern Generation for a Biped Robot with Hybrid CPG-ZMP Algorithm

Economical Quadrupedal Multi-Gait Locomotion via Gait-Heuristic Reinforcement Learning

of Advanced Robotic Systems Real-time Walking Pattern Generation for a Biped Robot with a Hybrid CPG-ZMP Algorithm immediate

Quadruped Robot Gait Planning Based on Genetic Algorithm