Abstract:Equipment maintenance support is an important technical measure to maintain the equipment’s expected performance. However, the current maintenance supports are mainly completed by maintainers under the guidance of technical manual or additional experts, which may be insufficient for some advanced equipment with rapid update rate and complex inner structure. The rising technology of augmented reality (AR) provides a new solution for equipment maintenance support, while one of the key issues limiting the practical application of AR in maintenance field is the spatial matching issue between virtual space and reality space. In this paper, a virtual-reality spatial matching algorithm is designed to accurately superimpose the virtual information to the corresponding actual scene on the AR glasses. In this algorithm, two methods are proposed to help achieve the stable matching of virtual space and reality space. In detail, to obtain the saliency map with less background interference and improved saliency detection accuracy, a saliency detection method is designed based on the super-pixel segmentation. To deal with the problems of uneven distribution on the feature points and weak robustness to the light changes, a feature extraction and matching method is proposed for acquiring the feature point matching set with the utilization of the obtained saliency map. Finally, an immersive equipment maintenance support system (IEMSS) is developed based on this spatial matching algorithm, which provides the maintainers with immediate and immersive guidance to improve the efficiency and safety in the maintenance task, as well as offers maintenance training for inexperienced maintainers with expanded virtual information in case of limited experts. Several comparative experiments are implemented to verify the effectiveness of proposed methods, and a user study of real system application is carried out to further evaluate the superiority of these methods when applied in the IEMSS.

Design and Application of Virtual Reality System in Fully Mechanized Mining Face

Virtual Reality System Based on PC for Mining Coal Face

A remote VR operation system for a fully mechanised coal-mining face using real-time data and collaborative network technology

A New Virtual Reality Training System for Underground Coal Mines

Design and Primary Implementation of Coalmine Virtual Environment System

Head-Mounted Display-Based Intuitive Virtual Reality Training System for the Mining Industry

A VR-based test and simulation system - With application in non-destructive evaluation

Virtual Factory Integrated Manufacturing System for Process Simulation and Monitoring

Design and Implementation of Mine Virtual Platform and Electromechanical Monitoring and Measuring Application

A VR Simulation Framework Integrated with Multisource CAE Analysis Data for Mechanical Equipment Working Process.

A VR-based interactive teaching and practice environment for supporting the whole process of mining engineering education

Development of a Visual Reality Headset and Its Applications in 3D Interactive Bike Race Games

A Virtual-Reality Spatial Matching Algorithm and Its Application on Equipment Maintenance Support: System Design and User Study

Realization and Design on 3D Engine Framework of Virtual Mine

Research on the Real-Time Mechatronic System Simulation Based on Virtual Reality

Application of the Computer Visual Simulation for Fully Mechanized Coal Face Research

An Integrated Virtual Design And Virtual Assembly Environment

Design and Implementation of Virtual Reality Simulation System for Petrochemical Enterprise

An Approach to Solid Modeling in a Semi-Immersive Virtual Environment.

Research and Implementation of Ancient Architecture Roaming System Based on VRML

Construction of Underground 3D Visualization Model of Mining Engineering Based on Shear-Warp Volume Computer Rendering Technology