Abstract:Classical policy search algorithms for robotics typically require performing extensive explorations, which are time-consuming and expensive to implement with real physical platforms. To facilitate the efficient learning of robot manipulation skills, in this work, we propose a new approach comprised of three modules: (1) learning of general prior knowledge with random explorations in simulation, including state representations, dynamic models, and the constrained action space of the task; (2) extraction of a state alignment-based reward function from a single demonstration video; (3) real-time optimization of the imitation policy under systematic safety constraints with sampling-based model predictive control. This solution results in an efficient one-shot imitation-from-video strategy that simplifies the learning and execution of robot skills in real applications. Specifically, we learn priors in a scene of a task family and then deploy the policy in a novel scene immediately following a single demonstration, preventing time-consuming and risky explorations in the environment. As we do not make a strong assumption of dynamic consistency between the scenes, learning priors can be conducted in simulation to avoid collecting data in real-world circumstances. We evaluate the effectiveness of our approach in the context of contact-rich fabric manipulation, which is a common scenario in industrial and domestic tasks. Detailed numerical simulations and real-world hardware experiments reveal that our method can achieve rapid skill acquisition for challenging manipulation tasks.

Survey of Imitation Learning for Robotic Manipulation

Learning Robot Manipulation Skills from Human Demonstration Videos Using Two-Stream 2-D/3-D Residual Networks with Self-Attention

Learning for a Robot: Deep Reinforcement Learning, Imitation Learning, Transfer Learning

A Review on Robot Manipulation Methods in Human-Robot Interactions

A Survey of Imitation Learning: Algorithms, Recent Developments, and Challenges

A Survey on Deep Reinforcement Learning Algorithms for Robotic Manipulation

Survey of Learning Approaches for Robotic In-Hand Manipulation

Watch and Act: Learning Robotic Manipulation from Visual Demonstration.

Survey of Learning-based Approaches for Robotic In-Hand Manipulation

Efficient Robot Skill Learning with Imitation from a Single Video for Contact-Rich Fabric Manipulation

Machine Learning Meets Advanced Robotic Manipulation

Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulation

A Survey of Embodied Learning for Object-Centric Robotic Manipulation

Robotic Manipulation with Reinforcement Learning, State Representation Learning, and Imitation Learning (Student Abstract)

Robotic Imitation of Human Actions

A Comparison of Imitation Learning Algorithms for Bimanual Manipulation

Vision-based Robot Manipulation Learning via Human Demonstrations

What Matters in Learning from Offline Human Demonstrations for Robot Manipulation

An Algorithmic Perspective on Imitation Learning