Abstract:Purpose In robot programming by demonstration (PbD) of small parts assembly tasks, the accuracy of parts poses estimated by vision-based techniques in demonstration stage is far from enough to ensure a successful execution. This paper aims to develop an inference method to improve the accuracy of poses and assembly relations between parts by integrating visual observation with computer-aided design (CAD) model. Design/methodology/approach In this paper, the authors propose a spatial information inference method called probabilistic assembly graph with optional CAD model, shorted as PAGC*, to achieve this task. Then an assembly relation extraction method from CAD model is designed, where different assembly relation descriptions in CAD model are summarized into two fundamental relations that are colinear and coplanar. The relation similarity, distance similarity and rotation similarity are adopted as the similar part matching criterions between the CAD model and the observation. The knowledge of part in CAD is used to correct that of the corresponding part in observation. The likelihood maximization estimation is used to infer the accurate poses and assembly relations based on the probabilistic assembly graph. Findings In the experiments, both simulated data and real-world data are applied to evaluate the performance of the PAGC* model. The experimental results show the superiority of PAGC* in accuracy compared with assembly graph (AG) and probabilistic assembly graph without CAD model (PAG). Originality/value The paper provides a new approach to get the accurate pose of each part in demonstration stage of the robot PbD system. By integrating information from visual observation with prior knowledge from CAD model, PAGC* ensures the success in execution stage of the PbD system.

System Dependence Graph Construction for Aspect Oriented C++

Apsect mining based on program dependence graph

An Approach to Analyzing Dependence Based on Exception Propagation Analysis

Inter-procedural static slicing of concurrent programs based on threaded System Dependence Graph (tSDG)

An Approach for Computing Dynamic Slice of Concurrent Aspect-Oriented Programs

Visual Exploration of Dependency Graph in Source Code Via Embedding-Based Similarity.

Slicing object-oriented java programs

A spatial information inference method for programming by demonstration of assembly tasks by integrating visual observation with CAD model

Measuring Aspect Cohesion

Dependence Analysis for Java

An approach to analyzing dependency of concurrent programs

An Approach to Analyzing Dependence of Concurrent Programs Based on Program Reachability Graphs

The program dependence graph and its use in optimization

Static Dependency Analysis For Concurrent Ada 95 Programs

On Composition and Reuse of Aspects

Dependence Analysis Of Concurrent Programs Based On Reachability Graph And Its Applications

Dependence Analysis for C Programs with Combinability of Dataflow Facts under Consideration

Causal Program Dependence Analysis

NICSDG: A Non-Intrusive Approach to Constructing Concise Service Dependency Graphs for Microservice Systems

An overview of aspect oriented programming and its related technical issues

Optimizing AspectJ Dynamic Advices Weaving Based on Aspect-Oriented Call Graph