Abstract:Learning from demonstration (LfD) provides a convenient means to equip robots with dexterous skills when demonstration can be obtained in robot intrinsic coordinates. However, the problem of compounding errors in long and complex skills reduces its wide deployment. Since most such complex skills are composed of smaller movements that are combined, considering the target skill as a sequence of compact motor primitives seems reasonable. Here the problem that needs to be tackled is to ensure that a motor primitive ends in a state that allows the successful execution of the subsequent primitive. In this study, we focus on this problem by proposing to learn an explicit correction policy when the expected transition state between primitives is not achieved. The correction policy is itself learned via behavior cloning by the use of a state-of-the-art movement primitive learning architecture, Conditional Neural Motor Primitives (CNMPs). The learned correction policy is then able to produce diverse movement trajectories in a context dependent way. The advantage of the proposed system over learning the complete task as a single action is shown with a table-top setup in simulation, where an object has to be pushed through a corridor in two steps. Then, the applicability of the proposed method to bi-manual knotting in the real world is shown by equipping an upper-body humanoid robot with the skill of making knots over a bar in 3D space. The experiments show that the robot can perform successful knotting even when the faced correction cases are not part of the human demonstration set.

Interactive Human-in-the-loop Coordination of Manipulation Skills Learned from Demonstration

Learning Robot Manipulation Skills from Human Demonstration Videos Using Two-Stream 2-D/3-D Residual Networks with Self-Attention

Learning Forceful Manipulation Skills from Multi-modal Human Demonstrations

COMBINATION OF AFFINE DEFORMATION AND DYNAMIC MOVEMENT PRIMITIVE IN LEARNING HUMAN MOTION FOR REDUNDANT MANIPULATOR

Learning from Demonstration for 7-DOF Anthropomorphic Manipulators Without Offset Via Analytical Inverse Kinematics

Diff-LfD: Contact-aware Model-based Learning from Visual Demonstration for Robotic Manipulation Via Differentiable Physics-based Simulation and Rendering.

Passive Bimanual Skills Learning From Demonstration With Motion Graph Attention Networks

Learning from Successful and Failed Demonstrations via Optimization

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation

Learning from Demonstration Framework for Multi-Robot Systems Using Interaction Keypoints and Soft Actor-Critic Methods

Fuzzy dynamical system for robot learning motion skills from human demonstration

Bimanual rope manipulation skill synthesis through context dependent correction policy learning from human demonstration

Logic Learning from Demonstrations for Multi-step Manipulation Tasks in Dynamic Environments

Training Humans to Train Robots Dynamic Motor Skills

Combining Learning from Demonstration with Learning by Exploration to Facilitate Contact-Rich Tasks

Learning Cooperative Dynamic Manipulation Skills from Human Demonstration Videos

Geometric Task Networks: Learning Efficient and Explainable Skill Coordination for Object Manipulation

Learning Task Planning from Multi-Modal Demonstration for Multi-Stage Contact-Rich Manipulation

Learning to Scaffold the Development of Robotic Manipulation Skills

An Adaptive Framework for Manipulator Skill Reproduction in Dynamic Environments

TEAM: a parameter-free algorithm to teach collaborative robots motions from user demonstrations