AUGMENTED REALITY WITH LIVE VIDEO STREAMING FOR BEYOND VISUAL LINE OF SIGHT INSPECTION FOR A STEEL BRIDGE

J. Runji,Genda Chen
DOI: https://doi.org/10.12783/shm2023/36980
2023-09-12
Abstract:A Bridge inspection is routinely conducted to enhance its useful life and ensure user safety within prescribed standards. In this paper, an automated inspection of steel bridges beyond the visual line of sight (BVLOS) is explored with the use of a climbing robot providing live video streams in an augmented reality (AR) environment. We anticipate a reduction in computational complexity involved in stabilizing video feeds due to camera jitter and rolling shutter effects, improved image resolution of observed defects hence their early detection, and reduced training effort to operators through our intuitive interface. Previously, AR has been employed in bridge inspection to visualize building information modelling (BIM), evaluate impact echo delamination, observe bridge deterioration information, update BIM data with higher precision, reduce ambiguity in data collection, support in-office preparations, and extract 3D measurements, using ground robots in collaborative systems. To the best of our knowledge no previous attempt has been made to investigate a collaborative bridge inspection system aided by AR for teleoperation of climbing robots on steel bridges in BVLOS scenarios. The outcome of this research is anticipated to guide future bridge inspection standards towards more computationally efficient systems, minimizing the cognitive workload of the robot pilots compared to unmanned aerial vehicles (UAV) pilots, improving cost effectiveness, with minimal disruption to traffic. Use of real-time audio-visual augmentations will be initially evaluated for a two-person human-robot collaborative system. Visual feedback will be employed to teleoperate the robot on a lab-based steel bridge model while audio feedback is employed to coordinate the two operators across a wireless communication network.
Engineering,Computer Science,Materials Science
What problem does this paper attempt to address?