Abstract:The industrial robot plays an increasingly important role in manufacturing industry, but it is limited by its high prerequisite of programming on users, which is time consuming and challenging. In this context, a mechanism enabling autoprogram of robot is desired. Learning from demonstration system (LDS) is one of systems that aim on this goal. In this paper, we present a graph based representation of knowledge called assembly graph (AG) to describe the knowledge on parts assembly, which is independent on specific workspace or robot. Based on this graph representation, a LDS framework is then proposed for parts assembly to enable knowledge transform and knowledge transfer. The former means that the knowledge on part assembly can be transformed from the human to the robot and the latter means that the knowledge can be transferred from the leaned computer to any other robots with other workspace. Besides, we present an implementation of this conceptual framework consisting of two stages including demonstration and execution. In demonstration stage, a human teacher shows the process of parts assembly, which is recorded by a camera system. The assembly relations are detected from images and represented by AG. It is solved by taking property of parts as well as the robot into consideration to obtain the precise pose of each part. By using the solution, the robot can assemble the parts as shown in demonstration in the execution stage. In the experiment, the building blocks are used for assembly. Our robot succeeds in assembling some building blocks together which is initially demonstrated by a human teacher.

Robot Learning from Demonstration for Assembly with Camera-Supplemented Optical Motion Capture Sensors

Towards Learning from Demonstration System for Parts Assembly: A Graph Based Representation for Knowledge

COMBINATION OF AFFINE DEFORMATION AND DYNAMIC MOVEMENT PRIMITIVE IN LEARNING HUMAN MOTION FOR REDUNDANT MANIPULATOR

A Robot Learning from Demonstration Platform Based on Optical Motion Capture

Perception of Demonstration for Automatic Programing of Robotic Assembly: Framework, Algorithm, and Validation

Learning-Based Hand Motion Capture and Understanding in Assembly Process

A Learning from Demonstration Method for Robotic Assembly with a Dual-Sub-6-DoF Parallel Robot *

A Robot 3C Assembly Skill Learning Method by Intuitive Human Assembly Demonstration

Robot Learning from Demonstration for Assembly with Sequential Assembly Movement Primitives

A Human–Robot Collaboration Method Using a Pose Estimation Network for Robot Learning of Assembly Manipulation Trajectories From Demonstration Videos

A Task-Learning Strategy for Robotic Assembly Tasks from Human Demonstrations

Robot Programming by Demonstration with Local Human Correction for Assembly

A robot learning from demonstration framework for skillful small parts assembly

One-shot sim-to-real transfer policy for robotic assembly via reinforcement learning with visual demonstration

A Learning from Demonstration Method for Generating Human-like Actions on Redundant Manipulators

Prediction-Based Human-Robot Collaboration in Assembly Tasks Using a Learning from Demonstration Model

Learning Articulated Motions From Visual Demonstration

Diff-LfD: Contact-aware Model-based Learning from Visual Demonstration for Robotic Manipulation Via Differentiable Physics-based Simulation and Rendering.

Research on LFD System of Humanoid Dual-Arm Robot

Subtask-learning Based for Robot Self-Assembly in Flexible Collaborative Assembly in Manufacturing

Watch and Act: Learning Robotic Manipulation from Visual Demonstration.