Research on target recognition and tracking in mobile augmented reality assisted maintenance

Libo Sun,Xiaokai Zhang,Wenhu Qin
DOI: https://doi.org/10.1002/cav.2112
IF: 1.01
2022-08-21
Computer Animation and Virtual Worlds
Abstract:The framework architecture of mobile augmented reality assisted vehicle maintenance system. The system mainly includes three modules: maintenance target recognition module, tracking and registration module, and virtual‐real fusion module. The maintenance target recognition module is responsible for identifying specific targets; the tracking and registration module is responsible for tracking the maintenance target in real time; and the virtual‐real fusion module realizes the fusion of virtual information and real scenes. The recognition and tracking of maintenance targets is the basis of augmented reality assisted maintenance. To address the problems of the current recognition and tracking algorithms, such as high time complexity, low pose tracking accuracy, and high requirements for hardware equipment, this paper studies a light weight maintenance target recognition algorithm based on YOLOv5s, and then the VI ORB‐SLAM algorithm is adopted to track the maintenance target. In addition, the ORB feature extraction and the visual inertial initialization are improved for the VI ORB‐SLAM algorithm. Finally, the combined algorithm is deployed on the mobile phone. Taking the augmented reality assisted vehicle maintenance as an example, it is verified that the proposed approach is practical feasible and effective in the actual assisted maintenance scene.
computer science, software engineering
What problem does this paper attempt to address?