Abstract:Purpose In robot programming by demonstration (PbD) of small parts assembly tasks, the accuracy of parts poses estimated by vision-based techniques in demonstration stage is far from enough to ensure a successful execution. This paper aims to develop an inference method to improve the accuracy of poses and assembly relations between parts by integrating visual observation with computer-aided design (CAD) model. Design/methodology/approach In this paper, the authors propose a spatial information inference method called probabilistic assembly graph with optional CAD model, shorted as PAGC*, to achieve this task. Then an assembly relation extraction method from CAD model is designed, where different assembly relation descriptions in CAD model are summarized into two fundamental relations that are colinear and coplanar. The relation similarity, distance similarity and rotation similarity are adopted as the similar part matching criterions between the CAD model and the observation. The knowledge of part in CAD is used to correct that of the corresponding part in observation. The likelihood maximization estimation is used to infer the accurate poses and assembly relations based on the probabilistic assembly graph. Findings In the experiments, both simulated data and real-world data are applied to evaluate the performance of the PAGC* model. The experimental results show the superiority of PAGC* in accuracy compared with assembly graph (AG) and probabilistic assembly graph without CAD model (PAG). Originality/value The paper provides a new approach to get the accurate pose of each part in demonstration stage of the robot PbD system. By integrating information from visual observation with prior knowledge from CAD model, PAGC* ensures the success in execution stage of the PbD system.

ROBOTIC ASSEMBLY ANALYSIS BASED ON C SPACE AND BOUNDARY GRAPH

Assembly Sequence Generation for New Objects Via Experience Learned from Similar Object

KGAssembly: Knowledge Graph-Driven Assembly Process Generation and Evaluation for Complex Components

A spatial information inference method for programming by demonstration of assembly tasks by integrating visual observation with CAD model

Knowledge-based Intelligent Assembly Planning System and Its Related Key Technologies

An Assembly Process Modeling and Analysis for Robotic Multiple Peg-in-hole

A generic approach for analysis of mechanical assembly

Contact Analysis in Robot Double Peg-in-Hole Assembly with Screw

A knowledge-based approach to assembly sequence planning

Complicated assembly analysis on multiple peg- in - hole insertion with multi - sided constraints

Research on Automatic Acquisition of Assembly Mating Constraints

Error Analysis of Robotic Assembly System Based on Screw Theory

Research on Robotic Flexible Peg-in-hole Assembly Technology

A Collaborative Approach To Assembly Sequence Planning

Constrain based method for describing and inferring position of assemblies

A Modeling Method of Complex Assembly Based on Digital Twin

Design of Robotic Multi-peg-in-hole Deformable Assembly

Knowledge-Based Assembly Sequence Planning System

Automatic Process Planning and Subassembly Detection for Auto-body Assembly

The state of the art of search strategies in robotic assembly

The Research on Subassembly Detection in Assembly Sequence Planning