Abstract:Machine learning algorithms have found several applications in the field of robotics and control systems. The control systems community has started to show interest towards several machine learning algorithms from the sub-domains such as supervised learning, imitation learning and reinforcement learning to achieve autonomous control and intelligent decision making. Amongst many complex control problems, stable bipedal walking has been the most challenging problem. In this paper, we present an architecture to design and simulate a planar bipedal walking robot(BWR) using a realistic robotics simulator, Gazebo. The robot demonstrates successful walking behaviour by learning through several of its trial and errors, without any prior knowledge of itself or the world dynamics. The autonomous walking of the BWR is achieved using reinforcement learning algorithm called Deep Deterministic Policy Gradient(DDPG). DDPG is one of the algorithms for learning controls in continuous action spaces. After training the model in simulation, it was observed that, with a proper shaped reward function, the robot achieved faster walking or even rendered a running gait with an average speed of 0.83 m/s. The gait pattern of the bipedal walker was compared with the actual human walking pattern. The results show that the bipedal walking pattern had similar characteristics to that of a human walking pattern. The video presenting our experiment is available at <a class="link-external link-https" href="https://goo.gl/NHXKqR" rel="external noopener nofollow">this https URL</a>.

Simulation for Passive Dynamic Walking Robot Based on Reinforcement Learning Algorithm

Reinforcement learning for passive dynamic walking robot

A Reinforcement Learning Based Dynamic Walking Control

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

Feedback Control of Planar Biped Robot with Regulable Step Length and Walking Speed

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

Dynamic walking control of humanoid robots combining linear inverted pendulum mode with parameter optimization

Passivity-Based Dynamic Bipedal Walking With Terrain Adaptability Dynamics, Control And Robotic Applications

Quasi Open-loop Control for Semi-passive Biped Robots

Adaptive Walking of a Quadrupedal Robot Based on Layered Biological Reflexes

Motion Sequence Learning for Robot Walking Based on Pose optimization

Passive Dynamic Walking of a Biped Robot with Torso and Its Stabilizer

Dynamic Walking on Uneven Terrains with Passivity-Based Bipedal Robots

Active online learning of the bipedal walking

Bipedal Walking Robot using Deep Deterministic Policy Gradient

Modeling and reinforcement learning-based locomotion control for a humanoid robot with kinematic loop closures

Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots

Learning Robust, Agile, Natural Legged Locomotion Skills in the Wild

Learning the Quadruped Robot by Reinforcement Learning (RL)

Time-Varying ALIP Model and Robust Foot-Placement Control for Underactuated Bipedal Robot Walking on a Swaying Rigid Surface

A Dynamic Bipedal Walking Method Using Coupled Elastic Actuation