Abstract:The industrial robot plays an increasingly important role in manufacturing industry, but it is limited by its high prerequisite of programming on users, which is time consuming and challenging. In this context, a mechanism enabling autoprogram of robot is desired. Learning from demonstration system (LDS) is one of systems that aim on this goal. In this paper, we present a graph based representation of knowledge called assembly graph (AG) to describe the knowledge on parts assembly, which is independent on specific workspace or robot. Based on this graph representation, a LDS framework is then proposed for parts assembly to enable knowledge transform and knowledge transfer. The former means that the knowledge on part assembly can be transformed from the human to the robot and the latter means that the knowledge can be transferred from the leaned computer to any other robots with other workspace. Besides, we present an implementation of this conceptual framework consisting of two stages including demonstration and execution. In demonstration stage, a human teacher shows the process of parts assembly, which is recorded by a camera system. The assembly relations are detected from images and represented by AG. It is solved by taking property of parts as well as the robot into consideration to obtain the precise pose of each part. By using the solution, the robot can assemble the parts as shown in demonstration in the execution stage. In the experiment, the building blocks are used for assembly. Our robot succeeds in assembling some building blocks together which is initially demonstrated by a human teacher.

A Robot Assembly Framework with “Perception-Action” Mapping Cognitive Learning

Perception of Demonstration for Automatic Programing of Robotic Assembly: Framework, Algorithm, and Validation

Learning-Based Hand Motion Capture and Understanding in Assembly Process

Towards Learning from Demonstration System for Parts Assembly: A Graph Based Representation for Knowledge

Skill learning for robotic assembly based on visual perspectives and force sensing

Perception-enhancement Based Task Learning and Action Scheduling for Robotic Limb in CPS Environment

Vision-force-fused curriculum learning for robotic contact-rich assembly tasks

Learning Robotic Assembly from CAD

Contact Skill Imitation Learning for Robot-Independent Assembly Programming

CLFR-M: Continual Learning Framework for Robots Via Human Feedback and Dynamic Memory

Imitation and Supervised Learning of Compliance for Robotic Assembly

A novel task-oriented framework for dual-arm robotic assembly task

Skill acquisition framework in multi-robot precision assembly based on cooperative compliant control

Cognitive Manipulation: Semi-supervised Visual Representation and Classroom-to-real Reinforcement Learning for Assembly in Semi-structured Environments

Deep reinforcement learning on variable stiffness compliant control for programming-free robotic assembly in smart manufacturing

RoboAssembly: Learning Generalizable Furniture Assembly Policy in a Novel Multi-robot Contact-rich Simulation Environment

Learning Optimal Measurement and Control of Assembly Robot for Large-Scale Heavy-Weight Parts

Modeling, planning, and scheduling of shop-floor assembly process with dynamic cyber-physical interactions: a case study for CPS-based smart industrial robot production

Learning-Based Variable Compliance Control for Robotic Assembly

Robot autonomous grasping and assembly skill learning based on deep reinforcement learning

AssemblyComplete: 3D Combinatorial Construction with Deep Reinforcement Learning