Abstract:Deep reinforcement learning provides a model-free method to teach a bipedal robot to walk, which is always a challenging task. However, low convergence and training efficiency limit the applications. To overcome such limitations, in this work an effective framework combined with traditional controllers and reinforcement learning is proposed, based on the realistic robot model Robotis-op3. The objective is to realize the motion sequence learning based on pose optimization (MSLPO). The Q-learning algorithm is used to train the walking parameters of the traditional model-based controller to get optimized poses. Based on pose optimization, deep reinforcement learning is utilized to train the walking controller. By combining pose optimization and reinforcement learning with reward shaping, the effective controller is achieved that can make the robot walk in a stable and fast manner. The proposed controller attains over 468% improvement in velocity and 51.5% decrease in relative deviation compared with the traditional controller. The proposed framework can also significantly improve the training efficiency compared with a continuous reinforcement learning algorithm. The proposed model is implemented in a simulated environment Pybullet and tested in different terrains. This work can be extended to other tasks and it is independent of a particular robot model.

Reinforcement learning for passive dynamic walking robot

A Reinforcement Learning Based Dynamic Walking Control

Simulation for Passive Dynamic Walking Robot Based on Reinforcement Learning Algorithm

Stable walking control and strategy of under-actuated biped robot

System Overview and Walking Dynamics of a Passive Dynamic Walking Robot with Flat Feet

Walking Control of Semi-Passive Robot Via a Modified Q-Learning Algorithm

Some Survey On Passive Dynamic Walking

Modeling and Control of Passive Dynamic Walking Robot with Humanoid Gait

Design and Variable Parameter Control Strategy of Weight Support Gait Training Robot.

Dynamic Walking on Uneven Terrains with Passivity-Based Bipedal Robots

Passive Dynamic Biped Walking: A Survey

Passivity-Based Dynamic Bipedal Walking With Terrain Adaptability Dynamics, Control And Robotic Applications

Dynamic Walking Control of Underactuated 3D Biped Robot

Passive Biped Robot with Lateral Motion

Adaptive Walking of a Quadrupedal Robot Based on Layered Biological Reflexes

Study of reinforcement learning based shared control of walking-aid robot

Step Length and Velocity Control of a Dynamic Bipedal Walking Robot with Adaptable Compliant Joints

Learning Robust, Agile, Natural Legged Locomotion Skills in the Wild

A Biped Robot Learning to Walk like Human by Reinforcement Learning.

Motion Sequence Learning for Robot Walking Based on Pose optimization

Robust Control of Semi-passive Biped Dynamic Locomotion Based on a Discrete Control Lyapunov Function.