Abstract:A significant percentage of bridges in the United States are serving beyond their 50-year design life, and many of them are in poor condition, making them vulnerable to fatigue cracks that can result in catastrophic failure. However, current fatigue crack inspection practice based on human vision is time-consuming, labor intensive, and prone to error. We present a novel human-centered bridge inspection methodology to enhance the efficiency and accuracy of fatigue crack detection by employing advanced technologies including computer vision and augmented reality (AR). In particular, a computer vision-based algorithm is developed to enable near-real-time fatigue crack detection by analyzing structural surface motion in a short video recorded by a moving camera of the AR headset. The approach monitors structural surfaces by tracking feature points and measuring variations in distances between feature point pairs to recognize the motion pattern associated with the crack opening and closing. Measuring distance changes between feature points, as opposed to their displacement changes before this improvement, eliminates the need of camera motion compensation and enables reliable and computationally efficient fatigue crack detection using the nonstationary AR headset. In addition, an AR environment is created and integrated with the computer vision algorithm. The crack detection results are transmitted to the AR headset worn by the bridge inspector, where they are converted into holograms and anchored on the bridge surface in the 3D real-world environment. The AR environment also provides virtual menus to support human-in-the-loop decision-making to determine optimal crack detection parameters. This human-centered approach with improved visualization and human–machine collaboration aids the inspector in making well-informed decisions in the field in a near-real-time fashion. The proposed crack detection method is comprehensively assessed using two laboratory test setups for both in-plane and out-of-plane fatigue cracks. Finally, using the integrated AR environment, a human-centered bridge inspection is conducted to demonstrate the efficacy and potential of the proposed methodology.

Vision-based spatial damage localization method for autonomous robotic laser cladding repair processes

A path planning method for surface damage repair using a robot-assisted laser cladding process

Model-informed Deep Learning Strategy with Vision Measurement for Damage Identification of Truss Structures

BROKEN AREA MODELING FOR REPAIR AUTOMATION

Worn area modeling for automating the repair of turbine blades

Detection and Quantification of Damage in Metallic Structures by Laser-Generated Ultrasonics

Vision-Based Adaptive Robotics for Autonomous Surface Crack Repair

Automated structural repair based on continuous carbon fiber reinforced plastic 3D printing and online model reconstruction

3D vision technologies for a self-developed structural external crack damage recognition robot

Development of Integrated Automatic System of Laser Cladding for Repairing of Polycrystalline Diamond Compact Bits

A novel damage detection method for carbon fibre reinforced polymer structures based on distributed strain measurements with fibre optical sensor

Automated damage detection of bridge’s sub-surface defects from infrared images using machine learning

In situ repairing of continuous fiber-reinforced thermoplastic composite via multi-axial additive manufacturing

Vision-Based Damage Detection for One-Fixed-End Structures Based on Aligned Marker Space and Decision Fusion

3D vision-based structural masonry damage detection

Computer Vision and Augmented Reality for Human-Centered Fatigue Crack Inspection

Model-enabled robotic machining framework for repairing paint film defects

A novel intelligent inspection robot with deep stereo vision for three-dimensional concrete damage detection and quantification

A multi-stage sub-structural damage localization approach using multi-label radial basis function neural network and auto-regressive model parameters

Using Augmented Reality to Assess and Modify Mobile Manipulator Surface Repair Plans

Holistic image‐based analysis of damage on concrete surfaces—A multifaceted approach based on supervised machine learning