Abstract:With growing access to versatile robotics, it is beneficial for end users to be able to teach robots tasks without needing to code a control policy. One possibility is to teach the robot through successful task executions. However, near-optimal demonstrations of a task can be difficult to provide and even successful demonstrations can fail to capture task aspects key to robust skill replication. Here, we propose a learning from demonstration (LfD) approach that enables learning of robust task definitions without the need for near-optimal demonstrations. We present a novel algorithmic framework for learning tasks based on the ergodic metric -- a measure of information content in motion. Moreover, we make use of negative demonstrations -- demonstrations of what not to do -- and show that they can help compensate for imperfect demonstrations, reduce the number of demonstrations needed, and highlight crucial task elements improving robot performance. In a proof-of-concept example of cart-pole inversion, we show that negative demonstrations alone can be sufficient to successfully learn and recreate a skill. Through a human subject study with 24 participants, we show that consistently more information about a task can be captured from combined positive and negative (posneg) demonstrations than from the same amount of just positive demonstrations. Finally, we demonstrate our learning approach on simulated tasks of target reaching and table cleaning with a 7-DoF Franka arm. Our results point towards a future with robust, data-efficient LfD for novice users.

Collaborative Robot Learning from Demonstrations using Hidden Markov Model State Distribution

Trajectory Generation with Multi-Stage Cost Functions Learned from Demonstrations

Learning to Collaborate from Simulation for Robot-Assisted Dressing

Learning from Demonstration Framework for Multi-Robot Systems Using Interaction Keypoints and Soft Actor-Critic Methods

Reinforcement Learning-based Learning from Demonstrations for Collaborative Robots

Learning Physical Collaborative Robot Behaviors From Human Demonstrations

Hierarchical Robot Learning for Physical Collaboration Between Humans and Robots

Efficient Model Learning for Human-Robot Collaborative Tasks

Robot Learning By Demonstration Interaction System Based On Multiple Information

Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human-Robot Interaction

Instructing Robots by Sketching: Learning from Demonstration via Probabilistic Diagrammatic Teaching

Ergodic imitation: Learning from what to do and what not to do

Demonstration Guided Actor-Critic Deep Reinforcement Learning for Fast Teaching of Robots in Dynamic Environments

A Human-Like Learning Framework of Robot Interaction Skills Based on Environmental Dynamics

A survey of robot learning from demonstration

Combined Task and Action Learning from Human Demonstrations for Mobile Manipulation Applications

A survey of robot learning from demonstrations for Human-Robot Collaboration

An Incremental Learning Framework to Enhance Teaching by Demonstration Based on Multimodal Sensor Fusion

Robot Learning from Demonstration Using Elastic Maps

Recent Advances in Robot Learning from Demonstration

User profile-driven large-scale multi-agent learning from demonstration in federated human-robot collaborative environments