Abstract:Purpose In robot programming by demonstration (PbD) of small parts assembly tasks, the accuracy of parts poses estimated by vision-based techniques in demonstration stage is far from enough to ensure a successful execution. This paper aims to develop an inference method to improve the accuracy of poses and assembly relations between parts by integrating visual observation with computer-aided design (CAD) model. Design/methodology/approach In this paper, the authors propose a spatial information inference method called probabilistic assembly graph with optional CAD model, shorted as PAGC*, to achieve this task. Then an assembly relation extraction method from CAD model is designed, where different assembly relation descriptions in CAD model are summarized into two fundamental relations that are colinear and coplanar. The relation similarity, distance similarity and rotation similarity are adopted as the similar part matching criterions between the CAD model and the observation. The knowledge of part in CAD is used to correct that of the corresponding part in observation. The likelihood maximization estimation is used to infer the accurate poses and assembly relations based on the probabilistic assembly graph. Findings In the experiments, both simulated data and real-world data are applied to evaluate the performance of the PAGC* model. The experimental results show the superiority of PAGC* in accuracy compared with assembly graph (AG) and probabilistic assembly graph without CAD model (PAG). Originality/value The paper provides a new approach to get the accurate pose of each part in demonstration stage of the robot PbD system. By integrating information from visual observation with prior knowledge from CAD model, PAGC* ensures the success in execution stage of the PbD system.

A Robot Programming by Demonstration Method for Precise Manipulation in 3C Assembly

Industrial Robot Programming by Demonstration

Perception of Demonstration for Automatic Programing of Robotic Assembly: Framework, Algorithm, and Validation

Robot Programming by Demonstration with Local Human Correction for Assembly

MASD: A Multimodal Assembly Skill Decoding System for Robot Programming by Demonstration.

A Robot 3C Assembly Skill Learning Method by Intuitive Human Assembly Demonstration

Robot Programming by Demonstration with Oral Instructions for Assembly.

Towards Learning from Demonstration System for Parts Assembly: A Graph Based Representation for Knowledge

Joining Force of Human Muscular Task Planning with Robot Robust and Delicate Manipulation for Programming by Demonstration

Human Demonstration Trajectory Refinement for Redundant Manipulators.

A spatial information inference method for programming by demonstration of assembly tasks by integrating visual observation with CAD model

Design of Demonstration-Driven Assembling Manipulator

A robot learning from demonstration framework for skillful small parts assembly

Robot Learning from Demonstration for Assembly with Sequential Assembly Movement Primitives

Probabilistic Graph Based Spatial Assembly Relation Inference for Programming of Assembly Task by Demonstration.

Robotic peg-in-hole assembly based on reversible dynamic movement primitives and trajectory optimization

A Task-Learning Strategy for Robotic Assembly Tasks from Human Demonstrations

Robot Learning from Demonstration for Assembly with Camera-Supplemented Optical Motion Capture Sensors

Multi-robot Collaborative Assembly Research for 3C Manufacturing-Taking Server Motherboard Assembly Task As an Example

A Human–Robot Collaboration Method Using a Pose Estimation Network for Robot Learning of Assembly Manipulation Trajectories From Demonstration Videos

Comparative Analysis of Programming by Demonstration Methods: Kinesthetic Teaching vs Human Demonstration