Abstract:Vision-assisted technologies in industrial manual operation such as augmented reality (AR) are increasingly popular. They require high positioning accuracy and robustness to operate normally. However, narrow spaces, moving hands, or tools may occlude or obscure local visual features of operation environments and thus affect the positioning accuracy and robustness of operating position. The resultant misguidance may even cause misoperation of operators. This paper proposes a marker-less monocular vision point positioning method for vision-assisted manual operation in industrial environments. The proposed method can accurately and robustly locate the target point of operation using constraint minimization method even if the target area has no corresponding visual features in the case of occlusion and improper illumination. The proposed method has three phases: intersection generation, intersection optimization, and target point solving. In the intersection generation phase, a certain number of intersections of epipolar lines are generated as candidate target points using fundamental matrices. Here, the solving constraint is converted from point-to-line to point-to-points. In the intersection optimization phase, the intersections are optimized to two different sets through the iterative linear fitting and geometric mean absolute error methods. Here, the solving constraint is further converted from point-to-points to point-to-point sets. In the target point solving phase, the target point is solved as a constrained minimization problem based on the distribution constraint of the two intersection sets. Here, the solving constraint is finally converted from point-to-point sets to point-to-point, and the unique optimal solution is obtained as the target point. The experimental results show that this method has a better accuracy and robustness than the traditional homography matrix method for the practical industrial operation scenes.

Industrial Operation Training Technology Based on Panoramic Image and Augmented Reality

A general framework of augmented reality aided teleoperation guidance

Does Augmented Reality Help in Industrial Training? A Comprehensive Evaluation Based on Natural Human Behavior and Knowledge Retention

An augmented reality-based application for equipment maintenance

Augmented Reality System Based on Panoramic Imaging

Augmented Reality Training System for Aerospace Product Assembly Process Guidance and Its Application

Integrating Knowledge and Augmented Reality: A Novel Framework for Intelligent Assembly Assistance

Augmented Reality Based Product Invisible Area Assembly Assistance

Augmented Reality System for Space-teleoperation Robot

Projection-based Augmented Reality System for Assembly Guidance and Monitoring

A systematic design method of adaptive augmented reality work instruction for complex industrial operations

A Marker-Less Monocular Vision Point Positioning Method for Industrial Manual Operation Environments

Potential Applications of Augmented Reality in Manned Space Engineering

A comprehensive review of augmented reality-based instruction in manual assembly, training and repair

Augmented Reality-based Auxiliary Device for Workshop Logistics Delivery

Augmented reality aided object mapping for worker assistance/training in an industrial assembly context: Exploration of affordance with existing guidance techniques

Applications of Augmented Reality for Maintenance Training.

Applying the Teaching Factory Paradigm and Augmented Reality Technology for Operator Training in Assembly Operations

An MR Remote Collaborative Platform Based on 3D CAD Models for Training in Industry

The research and application of the augmented reality technology

A Novel Method of Multitarget Augmented Reality Assembly Result Inspection for Large Complex Scenes