Abstract:The industrial robot plays an increasingly important role in manufacturing industry, but it is limited by its high prerequisite of programming on users, which is time consuming and challenging. In this context, a mechanism enabling autoprogram of robot is desired. Learning from demonstration system (LDS) is one of systems that aim on this goal. In this paper, we present a graph based representation of knowledge called assembly graph (AG) to describe the knowledge on parts assembly, which is independent on specific workspace or robot. Based on this graph representation, a LDS framework is then proposed for parts assembly to enable knowledge transform and knowledge transfer. The former means that the knowledge on part assembly can be transformed from the human to the robot and the latter means that the knowledge can be transferred from the leaned computer to any other robots with other workspace. Besides, we present an implementation of this conceptual framework consisting of two stages including demonstration and execution. In demonstration stage, a human teacher shows the process of parts assembly, which is recorded by a camera system. The assembly relations are detected from images and represented by AG. It is solved by taking property of parts as well as the robot into consideration to obtain the precise pose of each part. By using the solution, the robot can assemble the parts as shown in demonstration in the execution stage. In the experiment, the building blocks are used for assembly. Our robot succeeds in assembling some building blocks together which is initially demonstrated by a human teacher.

Learning Under-Specified Object Manipulations from Human Demonstrations.

Learning Robot Manipulation Skills from Human Demonstration Videos Using Two-Stream 2-D/3-D Residual Networks with Self-Attention

Learning Object Spatial Relationship from Demonstration

Hierarchical and Parameterized Learning of Pick-and-place Manipulation from Under-Specified Human Demonstrations

Perception of Demonstration for Automatic Programing of Robotic Assembly: Framework, Algorithm, and Validation

Towards Learning from Demonstration System for Parts Assembly: A Graph Based Representation for Knowledge

COMBINATION OF AFFINE DEFORMATION AND DYNAMIC MOVEMENT PRIMITIVE IN LEARNING HUMAN MOTION FOR REDUNDANT MANIPULATOR

Diff-LfD: Contact-aware Model-based Learning from Visual Demonstration for Robotic Manipulation Via Differentiable Physics-based Simulation and Rendering.

Instructing Robots by Sketching: Learning from Demonstration via Probabilistic Diagrammatic Teaching

Logic Learning from Demonstrations for Multi-step Manipulation Tasks in Dynamic Environments

Probabilistic Graph Based Spatial Assembly Relation Inference for Programming of Assembly Task by Demonstration.

Watch and Act: Learning Robotic Manipulation from Visual Demonstration.

Learning Task Specifications from Demonstrations as Probabilistic Automata

Interactive Human-in-the-loop Coordination of Manipulation Skills Learned from Demonstration

Vision-based Robot Manipulation Learning via Human Demonstrations

Learning from Demonstration with Weakly Supervised Disentanglement

Learning from Successful and Failed Demonstrations via Optimization

Robot programming by demonstration with situated spatial language understanding

Learning Forceful Manipulation Skills from Multi-modal Human Demonstrations

Learning Generalizable 3D Manipulation With 10 Demonstrations

Learning Human Compliant Behavior from Demonstration for Force-Based Robot Manipulation