Abstract:: Recent years have seen a Cambrian explosion of robotic systems yield-1 ing ever more capable and affordable systems, with quadrupedal robotic platforms 2 emerging as a commercially-viable base to perform a wide variety of tasks across 3 uneven terrain. Augmenting these with a robotic arm allows the possibility of even 4 more complex interactions. At the same time, there has been a growing body of 5 research into using deep reinforcement learning (DRL) for embodied agent navi-6 gation and object manipulation, which promises a more sample-efficient, flexible, 7 and robust approach to learning such policies than existing classical methods. Re-8 cent works have shown a functional approach for learning a joint base and arm 9 policy with DRL but have not yet demonstrated how the result can be used in 10 downstream tasks. In this work, we investigate the problem of learning an ob-11 ject manipulation and navigation policy for a quadrupedal robot with a mounted 12 robotic arm - specifically, we address the problem of fetching stationary and mov-13 ing objects autonomously (“playing fetch” with the robot dog). Our method con-14 sists of (a) a low-level policy that moves the base and arm and (b) a high-level 15 policy that generates the commands for the low-level policy. The low-level policy 16 is jointly learned for both the arm and the base which generates joint torques for 17 directional commands. The high-level policy is task-specific, translates the ball 18 position to directional commands for the low-level policy, and deals with accel-19 eration/deceleration and stability. We demonstrate that our high-level policy can 20 outperform a tuned Proportional-Derivative (PD) controller. 21

Learning the Quadruped Robot by Reinforcement Learning (RL)

Reinforcement Learning based Control of a Quadruped Robot

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Reinforcement Learning of Serpentine Locomotion for a Snake Robot

Reinforcement Learning For Quadrupedal Locomotion: Current Advancements And Future Perspectives

Quadruped Robot Locomotion in Unknown Terrain Using Deep Reinforcement Learning

Model Predictive Control of Quadruped Robot Based on Reinforcement Learning

Learning Bipedal Walking for Humanoids with Current Feedback

Learning Smooth and Omnidirectional Locomotion for Quadruped Robots

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

A Motion Planning and Control Method of Quadruped Robot Based on Deep Reinforcement Learning

Learning Agile, Robust Locomotion Skills for Quadruped Robot.

Heuristic Gait Learning of Quadruped Robot Based on Deep Deterministic Policy Gradient Algorithm

A Hierarchical Reinforcement Learning Approach to Control Legged Mobile Manipulators

Bipedal Walking Robot using Deep Deterministic Policy Gradient

Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control

RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotion

CPG-Based Hierarchical Locomotion Control for Modular Quadrupedal Robots Using Deep Reinforcement Learning.

Robust Walking and Sim-to-Real Optimization for Quadruped Robots via Reinforcement Learning

A Hierarchical Framework for Quadruped Robots Gait Planning Based on DDPG

Learning Bipedal Walking On Planned Footsteps For Humanoid Robots