Abstract:The application of Augmented Reality (AR) can effectively reduce the cognitive load of operators by presenting complex assembly work instruction with virtual augmented contents. If the virtual augmented contents superimposed on physical product without handling occlusion, the distortion may appear in AR guidance video. This paper proposes a monocular image based real-time occlusion handling method for virtual part model and physical product. In AR assistance assembly process, the virtual part model can be occluded by assembly scene or assembly objects. First, the monocular SLAM is used to reconstruct the assembly scene, and the reconstructed sparse 3D points are converted into depth points in the depth map. We use the color information of the assembly scene to control the propagation of parse depth points to the remaining pixels. With GPU acceleration calculation, a densification depth map of the assembly scene can be obtained. Then, the 3D models of the assembly objects are rendered as depth map according to the registration coordinates in AR assistance assembly system. The depth map of the assembly scene and assembly objects are synthesized as the final depth map for AR occlusion handling. Finally, the depth relationship between real assembly scenes, assembly objects, and virtual augmented contents are compared to determine the display pixels for AR effect. The results show that the proposed occlusion handling method shows high accuracy and fast speed in comparison with conventional methods, which demonstrates that our method can effectively solve the problem of occlusion handing for AR assistance assembly systems.

Research on Augmented Reality Assisted Material Delivery System in Digital Workshop

Augmented Reality-based Auxiliary Device for Workshop Logistics Delivery

A Markerless AR Guidance Method for Large-Scale Wire and Cable Laying of Electromechanical Products

Augmented Reality Based Product Invisible Area Assembly Assistance

3D Guiding Assisted Augmented Assembly Technology with Rapid Object Detection in Dynamic Environment

Integrating Knowledge and Augmented Reality: A Novel Framework for Intelligent Assembly Assistance

Multi-person Collaborative Augmented Reality Assembly Process Evaluation System Based on HoloLens

Research and Implementation on Key Technologies of Assembly Assistance System based on Augmented Reality

Integrated Registration and Occlusion Handling Based on Deep Learning for Augmented Reality Assisted Assembly Instruction

Material Kitting in Selective Assembly: a Manual Order Picking System Based on Augmented Reality

Real-time occlusion handling for augmented reality assistance assembly systems with monocular images

Application of Augmented Reality (AR) Technologies in inhouse Logistics

A 3D Tracking and Registration Method Based on Point Cloud and Visual Features for Augmented Reality Aided Assembly System

Deep learning-based augmented reality work instruction assistance system for complex manual assembly

A comprehensive review of augmented reality-based instruction in manual assembly, training and repair

Object Registration Using an RGB-D Camera for Complex Product Augmented Assembly Guidance

Distributed cognition based localization for AR-aided collaborative assembly in industrial environments

An AR-Enabled See-Through System for Vision Blind Areas.

Using Artificial Intelligence Assisted Learning Technology on Augmented Reality-Based Manufacture Workflow

An MR Remote Collaborative Platform Based on 3D CAD Models for Training in Industry