Abstract:DribbleBot (Dexterous Ball Manipulation with a Legged Robot) is a legged robotic system that can dribble a soccer ball under the same real-world conditions as humans (i.e., in-the-wild). We adopt the paradigm of training policies in simulation using reinforcement learning and transferring them into the real world. We overcome critical challenges of accounting for variable ball motion dynamics on different terrains and perceiving the ball using body-mounted cameras under the constraints of onboard computing. Our results provide evidence that current quadruped platforms are well-suited for studying dynamic whole-body control problems involving simultaneous locomotion and manipulation directly from sensory observations.

What problem does this paper attempt to address?

The paper aims to address the issue of dynamic mobile manipulation, specifically, by using reinforcement learning to train a quadruped robot, DribbleBot, to dribble a soccer ball in outdoor environments. DribbleBot is capable of performing dribbling actions on various natural terrains, such as sand, gravel, mud, and snow, which requires the robot to simultaneously handle visual perception, dynamic movement, and object manipulation. The paper tackles several key challenges: 1. **Adapting to different ball dynamics**: The rolling characteristics of the ball change on different terrains, necessitating the robot to adjust its strategy to cope with these variations. 2. **Ball perception based on onboard cameras**: Utilizing body-mounted cameras to accurately track a fast-moving ball under the constraints of limited onboard computational power. 3. **Fall recovery mechanism**: The ability for the robot to autonomously stand up and regain control of the ball after encountering extreme disturbances or falling on complex terrains. The approaches proposed in the paper include: - Training strategies using reinforcement learning in a simulated environment, then transferring them to the real world. - Enhancing the ball resistance model in the simulator to enable the robot to adapt to the ball dynamics on different terrains. - Developing an independent ball detection module using images captured by a fisheye camera to facilitate the transfer from simulation to the real world. - Integrating a recovery controller so that the robot can automatically stand up and continue dribbling after a fall. Experimental results show that DribbleBot is capable of executing dribbling actions on various terrains, including turning, and demonstrates certain performance on some challenging terrains. In addition, the paper also explores the robot's behavior during human interaction, demonstrating the robot's ability to maintain ball control when faced with external disturbances. In summary, this research provides new insights and technological advancements in the field of dynamic mobile manipulation.

DribbleBot: Dynamic Legged Manipulation in the Wild

DexDribbler: Learning Dexterous Soccer Manipulation via Dynamic Supervision

Motion Planning for a Legged Robot with Dynamic Characteristics

Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion

Perception-Driven Learning of High-Dynamic Jumping Motions for Single-Legged Robots

Learning Robust, Agile, Natural Legged Locomotion Skills in the Wild

Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion

Learning and Adapting Agile Locomotion Skills by Transferring Experience

Whole-Body Dynamic Throwing with Legged Manipulators

Visual Manipulation with Legs

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning

Creating a Dynamic Quadrupedal Robotic Goalkeeper with Reinforcement Learning

Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robot

Dynamic Bipedal Maneuvers through Sim-to-Real Reinforcement Learning

Dynamic Legged Manipulation of a Ball Through Multi-Contact Optimization

Helpful DoggyBot: Open-World Object Fetching using Legged Robots and Vision-Language Models

Learning Agile Bipedal Motions on a Quadrupedal Robot

Agile and versatile bipedal robot tracking control through reinforcement learning

DeepWalk: Omnidirectional Bipedal Gait by Deep Reinforcement Learning

Learning to Jump from Pixels