Abstract:: Recent years have seen a Cambrian explosion of robotic systems yield-1 ing ever more capable and affordable systems, with quadrupedal robotic platforms 2 emerging as a commercially-viable base to perform a wide variety of tasks across 3 uneven terrain. Augmenting these with a robotic arm allows the possibility of even 4 more complex interactions. At the same time, there has been a growing body of 5 research into using deep reinforcement learning (DRL) for embodied agent navi-6 gation and object manipulation, which promises a more sample-efficient, flexible, 7 and robust approach to learning such policies than existing classical methods. Re-8 cent works have shown a functional approach for learning a joint base and arm 9 policy with DRL but have not yet demonstrated how the result can be used in 10 downstream tasks. In this work, we investigate the problem of learning an ob-11 ject manipulation and navigation policy for a quadrupedal robot with a mounted 12 robotic arm - specifically, we address the problem of fetching stationary and mov-13 ing objects autonomously (“playing fetch” with the robot dog). Our method con-14 sists of (a) a low-level policy that moves the base and arm and (b) a high-level 15 policy that generates the commands for the low-level policy. The low-level policy 16 is jointly learned for both the arm and the base which generates joint torques for 17 directional commands. The high-level policy is task-specific, translates the ball 18 position to directional commands for the low-level policy, and deals with accel-19 eration/deceleration and stability. We demonstrate that our high-level policy can 20 outperform a tuned Proportional-Derivative (PD) controller. 21

Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

Visual Whole-Body Control for Legged Loco-Manipulation

Learning Force Control for Legged Manipulation

A Hierarchical Reinforcement Learning Approach to Control Legged Mobile Manipulators

Manipulator as a Tail: Promoting Dynamic Stability for Legged Locomotion

Visual Manipulation with Legs

Design and Analysis of a Whole-Body Controller for a Velocity Controlled Robot Mobile Manipulator

RoboDuet: Whole-body Legged Loco-Manipulation with Cross-Embodiment Deployment

Real-Time Whole-Body Control of Legged Robots with Model-Predictive Path Integral Control

UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers

Whole-Body Control for a Torque-Controlled Legged Mobile Manipulator

Hierarchical Optimization-based Control for Whole-body Loco-manipulation of Heavy Objects

One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotion

Learning Visual Quadrupedal Loco-Manipulation from Demonstrations

Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Control

Learning Whole-Body Loco-Manipulation for Omni-Directional Task Space Pose Tracking with a Wheeled-Quadrupedal-Manipulator

RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotion

Learning Whole-body Manipulation for Quadrupedal Robot