Abstract:Purpose This study aims to monitor and guide the assembly process. The operators need to change the assembly process according to the products' specifications during manual assembly of mass customized production. Traditional information inquiry and display methods, such as manual lookup of assembly drawings or electronic manuals, are inefficient and error-prone. Design/methodology/approach This paper proposes a projection-based augmented reality system (PBARS) for assembly guidance and monitoring. The system includes a projection method based on viewpoint tracking, in which the position of the operator's head is tracked and the projection images are changed correspondingly. The assembly monitoring phase applies a method for parts recognition. First, the pixel local binary pattern (PX-LBP) operator is achieved by merging the classical LBP operator with the pixel classification process. Afterward, the PX-LBP features of the depth images are extracted and the randomized decision forests classifier is used to get the pixel classification prediction image (PCPI). Parts recognition and assembly monitoring is performed by PCPI analysis. Findings The projection image changes with the viewpoint of the human body, hence the operators always perceive the three-dimensional guiding scene from different viewpoints, improving the human-computer interaction. Part recognition and assembly monitoring were achieved by comparing the PCPIs, in which missing and erroneous assembly can be detected online. Originality/value This paper designed the PBARS to monitor and guide the assembly process simultaneously, with potential applications in mass customized production. The parts recognition and assembly monitoring based on pixels classification provides a novel method for assembly monitoring.

Exploring Real-time Precision Feedback for AR-assisted Manual Adjustment in Mechanical Assembly

Usability of Pseudo-Haptic Feedback for Manual Precise Manipulation of Objects in Augmented Reality

A general framework of augmented reality aided teleoperation guidance

AR-Assisted Guidance for Assembly and Maintenance of Avionics Equipment

Digital twin model-based smart assembly strategy design and precision evaluation for PCB kit-box build

Assessing user performance in augmented reality assembly guidance for industry 4.0 operators

A comprehensive review of augmented reality-based instruction in manual assembly, training and repair

Should I Evaluate My Augmented Reality System in an Industrial Environment? Investigating the Effects of Classroom and Shop Floor Settings on Guided Assembly

A novel adaptive visualization method based on user intention in AR manual assembly

A natural bare-hand interface-enabled interactive AR assembly guidance

Projection-based Augmented Reality System for Assembly Guidance and Monitoring

Augmented Reality Training System for Aerospace Product Assembly Process Guidance and Its Application

A Natural Bare-Hand Interaction Method With Augmented Reality for Constraint-Based Virtual Assembly

Advancing Precision Equipment Co-Assembly: An Innovative VR/MR Interface Strategy

Influences of Augmented Reality Assistance on Performance and Cognitive Loads in Different Stages of Assembly Task

Augmented reality user interface design and experimental evaluation for human-robot collaborative assembly

Hand-in-Hand Guidance: an Explore-Exploit Based Reinforcement Learning Method for Performance Driven Assembly-Adjustment

Sequential dynamic gesture recognition controlled poka-yoke system for manual assembly

Efficient evaluation of misalignment between real and virtual objects for HMD-Based AR assembly assistance system

Usability study of a user-friendly AR assembly assistance

A Novel Method of Multitarget Augmented Reality Assembly Result Inspection for Large Complex Scenes