Abstract:Purpose This study aims to monitor and guide the assembly process. The operators need to change the assembly process according to the products' specifications during manual assembly of mass customized production. Traditional information inquiry and display methods, such as manual lookup of assembly drawings or electronic manuals, are inefficient and error-prone. Design/methodology/approach This paper proposes a projection-based augmented reality system (PBARS) for assembly guidance and monitoring. The system includes a projection method based on viewpoint tracking, in which the position of the operator's head is tracked and the projection images are changed correspondingly. The assembly monitoring phase applies a method for parts recognition. First, the pixel local binary pattern (PX-LBP) operator is achieved by merging the classical LBP operator with the pixel classification process. Afterward, the PX-LBP features of the depth images are extracted and the randomized decision forests classifier is used to get the pixel classification prediction image (PCPI). Parts recognition and assembly monitoring is performed by PCPI analysis. Findings The projection image changes with the viewpoint of the human body, hence the operators always perceive the three-dimensional guiding scene from different viewpoints, improving the human-computer interaction. Part recognition and assembly monitoring were achieved by comparing the PCPIs, in which missing and erroneous assembly can be detected online. Originality/value This paper designed the PBARS to monitor and guide the assembly process simultaneously, with potential applications in mass customized production. The parts recognition and assembly monitoring based on pixels classification provides a novel method for assembly monitoring.

Exploration and Practice of Aircraft Assembly AR Intelligent Pilot Technology

A Robot Assisted Assembly System for Small Components in Aircraft Assembly

AR-Assisted Guidance for Assembly and Maintenance of Avionics Equipment

A general framework of augmented reality aided teleoperation guidance

Augmented Reality Training System for Aerospace Product Assembly Process Guidance and Its Application

A systematic design method of adaptive augmented reality work instruction for complex industrial operations

AIoT for Aircraft Final Assembly: an Intelligent and Collaborative Framework

Research and Implementation on Key Technologies of Assembly Assistance System based on Augmented Reality

Implementation of Augmented Reality in Aircraft Inspection Process

Development and Application of Parts Assembly Guidance System Based on Augmented Reality

Cross-platform AR Annotation for Assembly-Design Communication in Pipe Outfitting

Projection-based Augmented Reality System for Assembly Guidance and Monitoring

Information Integration and Instruction Authoring of Augmented Assembly Systems

A smart assistance system for cable assembly by combining wearable augmented reality with portable visual inspection

A comprehensive review of augmented reality-based instruction in manual assembly, training and repair

Piping installation support system using augmented reality

Deep learning-based augmented reality work instruction assistance system for complex manual assembly

A novel adaptive visualization method based on user intention in AR manual assembly

AR Aircraft Exterior Inspection System Based on Visual SLAM Technology

A Pragmatic System to Support Interactive Assembly Planning and Training in an Immersive Virtual Environment (I-VAPTS)

A natural bare-hand interface-enabled interactive AR assembly guidance