Abstract:Equipment maintenance support is an important technical measure to maintain the equipment’s expected performance. However, the current maintenance supports are mainly completed by maintainers under the guidance of technical manual or additional experts, which may be insufficient for some advanced equipment with rapid update rate and complex inner structure. The rising technology of augmented reality (AR) provides a new solution for equipment maintenance support, while one of the key issues limiting the practical application of AR in maintenance field is the spatial matching issue between virtual space and reality space. In this paper, a virtual-reality spatial matching algorithm is designed to accurately superimpose the virtual information to the corresponding actual scene on the AR glasses. In this algorithm, two methods are proposed to help achieve the stable matching of virtual space and reality space. In detail, to obtain the saliency map with less background interference and improved saliency detection accuracy, a saliency detection method is designed based on the super-pixel segmentation. To deal with the problems of uneven distribution on the feature points and weak robustness to the light changes, a feature extraction and matching method is proposed for acquiring the feature point matching set with the utilization of the obtained saliency map. Finally, an immersive equipment maintenance support system (IEMSS) is developed based on this spatial matching algorithm, which provides the maintainers with immediate and immersive guidance to improve the efficiency and safety in the maintenance task, as well as offers maintenance training for inexperienced maintainers with expanded virtual information in case of limited experts. Several comparative experiments are implemented to verify the effectiveness of proposed methods, and a user study of real system application is carried out to further evaluate the superiority of these methods when applied in the IEMSS.

A Distributed System Monitoring Tool with Virtual Reality

Distributed Management of Virtual Reality Digital Assets for Online Experimental Education

Virtual Factory Integrated Manufacturing System for Process Simulation and Monitoring

Design of the Virtual Reality-based Remote Equipment Monitoring System

Information Monitor Research Oriented to Complex Virtual Test Supporting Environment

Development and Application of Workshop Virtual Monitoring System Based on Unity

Research on 3D Remote Virtual Monitoring for Tower Crane

A Virtual-Reality Spatial Matching Algorithm and Its Application on Equipment Maintenance Support: System Design and User Study

Development of a Visualized Data Management System for Life-Cycle Health Monitoring of Civil Structures

Design of monitor virtual teaching system based on mixed reality technology

Research on Remote Virtual Monitoring System of Port Machinery

Visual Perception Design and Evaluation of Electric Working Robots

A large display-based approach supporting natural user interaction in virtual reality environment

UrbanVR: An immersive analytics system for context-aware urban design

Remote Monitoring and Teleoperation of Autonomous Vehicles $-$ Is Virtual Reality an Option?

Remote monitoring system of shearer based on Quest3D and PLC

Dvenet: A Distributed Integrate Environment of Virtual Reality Application

Virtual Inspection System for Pumping Stations with Multimodal Feedback

A virtual reality data visualization tool for dimensionality reduction methods

Stereo Vision Based Robot for Remote Monitoring with VR Support

Research on the Real-Time Mechatronic System Simulation Based on Virtual Reality