Abstract:Purpose This study aims to monitor and guide the assembly process. The operators need to change the assembly process according to the products' specifications during manual assembly of mass customized production. Traditional information inquiry and display methods, such as manual lookup of assembly drawings or electronic manuals, are inefficient and error-prone. Design/methodology/approach This paper proposes a projection-based augmented reality system (PBARS) for assembly guidance and monitoring. The system includes a projection method based on viewpoint tracking, in which the position of the operator's head is tracked and the projection images are changed correspondingly. The assembly monitoring phase applies a method for parts recognition. First, the pixel local binary pattern (PX-LBP) operator is achieved by merging the classical LBP operator with the pixel classification process. Afterward, the PX-LBP features of the depth images are extracted and the randomized decision forests classifier is used to get the pixel classification prediction image (PCPI). Parts recognition and assembly monitoring is performed by PCPI analysis. Findings The projection image changes with the viewpoint of the human body, hence the operators always perceive the three-dimensional guiding scene from different viewpoints, improving the human-computer interaction. Part recognition and assembly monitoring were achieved by comparing the PCPIs, in which missing and erroneous assembly can be detected online. Originality/value This paper designed the PBARS to monitor and guide the assembly process simultaneously, with potential applications in mass customized production. The parts recognition and assembly monitoring based on pixels classification provides a novel method for assembly monitoring.

A Blind Area Information Perception and AR Assembly Guidance Method Based on RGBD Data for Dynamic Environments and User Study

Augmented Reality Based Product Invisible Area Assembly Assistance

Visual Guidance Method for Artificial Assembly in Visual Blind Areas Based on Augmented Reality

Product Blind Area Assembly Method Based on Augmented Reality and Machine Vision

Long-Range Traversability Awareness and Low-Lying Obstacle Negotiation with RealSense for the Visually Impaired

First- and Third-person Perspectives in the AR-assisted Blind Area Assembly

Integrate Augmented Reality and Force Sensing Devices to Assist Blind Area Assembly

Expanding the Detection of Traversable Area with RealSense for the Visually Impaired

An AR-Enabled See-Through System for Vision Blind Areas.

Seeing is Believing: AR-assisted Blind Area Assembly to Support Hand–eye Coordination

Projection-based Augmented Reality System for Assembly Guidance and Monitoring

3D Guiding Assisted Augmented Assembly Technology with Rapid Object Detection in Dynamic Environment

AR-Assisted Guidance for Assembly and Maintenance of Avionics Equipment

Integrating Knowledge and Augmented Reality: A Novel Framework for Intelligent Assembly Assistance

AR-assisted assembly method based on instance segmentation

A novel adaptive visualization method based on user intention in AR manual assembly

Edge Computing Driven Scene-aware Intelligent Augmented Reality for Manual Assembly

Study on the Perception Mechanism and Method of Virtual and Real Objects in Augmented Reality Assembly Environment

Object Registration Using an RGB-D Camera for Complex Product Augmented Assembly Guidance

A Multi-Modal Context-Aware Sequence Stage Validation for Human-Centric AR Assembly

Development and Application of Parts Assembly Guidance System Based on Augmented Reality