Abstract:Purpose In robot programming by demonstration (PbD) of small parts assembly tasks, the accuracy of parts poses estimated by vision-based techniques in demonstration stage is far from enough to ensure a successful execution. This paper aims to develop an inference method to improve the accuracy of poses and assembly relations between parts by integrating visual observation with computer-aided design (CAD) model. Design/methodology/approach In this paper, the authors propose a spatial information inference method called probabilistic assembly graph with optional CAD model, shorted as PAGC*, to achieve this task. Then an assembly relation extraction method from CAD model is designed, where different assembly relation descriptions in CAD model are summarized into two fundamental relations that are colinear and coplanar. The relation similarity, distance similarity and rotation similarity are adopted as the similar part matching criterions between the CAD model and the observation. The knowledge of part in CAD is used to correct that of the corresponding part in observation. The likelihood maximization estimation is used to infer the accurate poses and assembly relations based on the probabilistic assembly graph. Findings In the experiments, both simulated data and real-world data are applied to evaluate the performance of the PAGC* model. The experimental results show the superiority of PAGC* in accuracy compared with assembly graph (AG) and probabilistic assembly graph without CAD model (PAG). Originality/value The paper provides a new approach to get the accurate pose of each part in demonstration stage of the robot PbD system. By integrating information from visual observation with prior knowledge from CAD model, PAGC* ensures the success in execution stage of the PbD system.

User Attention Aware Dynamic Visualization of Assembly Models

Assembly Sequence Generation for New Objects Via Experience Learned from Similar Object

Interactive task planning in virtual assembly.

A spatial information inference method for programming by demonstration of assembly tasks by integrating visual observation with CAD model

Motion data integration and monitoring of digital assembly system of aircraft

KGAssembly: Knowledge Graph-Driven Assembly Process Generation and Evaluation for Complex Components

MIVAS: A Multi-Modal Immersive Virtual Assembly System

Optimization Techniques for Assembly Planning of Complex Models in Large-scale Virtual Environments.

An Integrated Virtual Design And Virtual Assembly Environment

A novel adaptive visualization method based on user intention in AR manual assembly

Automatic Generation of 3D Assembly Dimension Chain Based on Feature Model

Probabilistic Graph Based Spatial Assembly Relation Inference for Programming of Assembly Task by Demonstration.

Dynamic furniture modeling through assembly instructions

Virtual Disassembly Based on Dynamic Constraint Release

The Multi-Level Representation of Product Information for Virtual Assembly

Constrained Behavior Manipulation for Interactive Assembly in a Virtual Environment

Virtual Assembly and Tolerance Analysis for Collaborative Design.

Temporal assembly model for virtual environment

A Hierarchical Approach to Disassembly Sequence Planning for Mechanical Product

Active Assembly Guidance with Online Video Parsing

Study on Generation of 3D Assembly Dimension Chain