Abstract:: Recent years have seen a Cambrian explosion of robotic systems yield-1 ing ever more capable and affordable systems, with quadrupedal robotic platforms 2 emerging as a commercially-viable base to perform a wide variety of tasks across 3 uneven terrain. Augmenting these with a robotic arm allows the possibility of even 4 more complex interactions. At the same time, there has been a growing body of 5 research into using deep reinforcement learning (DRL) for embodied agent navi-6 gation and object manipulation, which promises a more sample-efficient, flexible, 7 and robust approach to learning such policies than existing classical methods. Re-8 cent works have shown a functional approach for learning a joint base and arm 9 policy with DRL but have not yet demonstrated how the result can be used in 10 downstream tasks. In this work, we investigate the problem of learning an ob-11 ject manipulation and navigation policy for a quadrupedal robot with a mounted 12 robotic arm - specifically, we address the problem of fetching stationary and mov-13 ing objects autonomously (“playing fetch” with the robot dog). Our method con-14 sists of (a) a low-level policy that moves the base and arm and (b) a high-level 15 policy that generates the commands for the low-level policy. The low-level policy 16 is jointly learned for both the arm and the base which generates joint torques for 17 directional commands. The high-level policy is task-specific, translates the ball 18 position to directional commands for the low-level policy, and deals with accel-19 eration/deceleration and stability. We demonstrate that our high-level policy can 20 outperform a tuned Proportional-Derivative (PD) controller. 21

The Shortcomings of Force-from-Motion in Robot Learning

On the Role of the Action Space in Robot Manipulation Learning and Sim-to-Real Transfer

A Comparative Study on State-Action Spaces for Learning Viewpoint Selection and Manipulation with Diffusion Policy

Learning Models For Constraint-Based Motion Parameterization From Interactive Physics-Based Simulation

Exploiting Symmetry and Heuristic Demonstrations in Off-policy Reinforcement Learning for Robotic Manipulation

Learning Force Control for Contact-Rich Manipulation Tasks With Rigid Position-Controlled Robots

Learning Force Control for Legged Manipulation

A Comparison of Action Spaces for Learning Manipulation Tasks

Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human-Robot Interaction

Admittance Visuomotor Policy Learning for General-Purpose Contact-Rich Manipulations

Symmetric Models for Visual Force Policy Learning

Highly dynamic physical interaction for robotics: design and control of an active remote center of compliance

Just Add Force for Contact-Rich Robot Policies

A Hierarchical Reinforcement Learning Approach to Control Legged Mobile Manipulators

Learning Movement Assessment Primitives for Force Interaction Skills

Dynamic Motion Primitives-Based Trajectory Learning for Physical Human–Robot Interaction Force Control

Nonprehensile Riemannian Motion Predictive Control

Learning-Based Control for Soft Robot–Environment Interaction with Force/Position Tracking Capability

Learning Task Space Actions for Bipedal Locomotion

Force-Motion Control For A Six Degree-Of-Freedom Robotic Manipulator

Learning Kinematic Feasibility for Mobile Manipulation through Deep Reinforcement Learning