Abstract:Learning goal conditioned control in the real world is a challenging open problem in robotics. Reinforcement learning systems have the potential to learn autonomously via trial-and-error, but in practice the costs of manual reward design, ensuring safe exploration, and hyperparameter tuning are often enough to preclude real world deployment. Imitation learning approaches, on the other hand, offer a simple way to learn control in the real world, but typically require costly curated demonstration data and lack a mechanism for continuous improvement. Recently, iterative imitation techniques have been shown to learn goal directed control from undirected demonstration data, and improve continuously via self-supervised goal reaching, but results thus far have been limited to simulated environments. In this work, we present evidence that iterative imitation learning can scale to goal-directed behavior on a real robot in a dynamic setting: high speed, precision table tennis (e.g. "land the ball on this particular target"). We find that this approach offers a straightforward way to do continuous on-robot learning, without complexities such as reward design or sim-to-real transfer. It is also scalable -- sample efficient enough to train on a physical robot in just a few hours. In real world evaluations, we find that the resulting policy can perform on par or better than amateur humans (with players sampled randomly from a robotics lab) at the task of returning the ball to specific targets on the table. Finally, we analyze the effect of an initial undirected bootstrap dataset size on performance, finding that a modest amount of unstructured demonstration data provided up-front drastically speeds up the convergence of a general purpose goal-reaching policy. See <a class="link-external link-https" href="https://sites.google.com/view/goals-eye" rel="external noopener nofollow">this https URL</a> for videos.

A Table Tennis Robot System Using an Industrial KUKA Robot Arm

A multi-modal table tennis robot system

Real-time vision system for a Ping-Pong robot

A Learning Framework Towards Real-Time Detection and Localization of a Ball for Robotic Table Tennis System

Spin Observation and Trajectory Prediction of a Ping-Pong Ball

A Humanoid Robot for Table Tennis Playing

Balance motion generation for a humanoid robot playing table tennis.

Vision based ping-pong ball tracking with physical model

Real-time Accurate Ball Trajectory Estimation with "asynchronous" Stereo Camera System for Humanoid Ping-Pong Robot.

Robotic Table Tennis: A Case Study into a High Speed Learning System

Accurate Real-Time Ball Trajectory Estimation with Onboard Stereo Camera System for Humanoid Ping-Pong Robot

An adaptive trajectory prediction method for ping-pong robots

Design, Modeling, and Experimental Validation of a Vision-Based Table Tennis Juggling Robot

Binocular Vision-Based Recognition Method for Table Tennis Motion Trajectory

Real-Time Spin Estimation of Ping-Pong Ball Using Its Natural Brand.

Computational Analysis of Table Tennis Matches from Real-Time Videos Using Deep Learning.

A Robust Vision Module for Humanoid Robotic Ping-Pong Game

Opponent Hitting Behavior Prediction and Ball Location Control for a Table Tennis Robot

Ball Tracking and Trajectory Prediction for Table-Tennis Robots

Achieving Human Level Competitive Robot Table Tennis

GoalsEye: Learning High Speed Precision Table Tennis on a Physical Robot