Abstract:Regular defect inspection of the bridge’s bottom is necessary for the maintenance of the bridge. Usually, conducting such an inspection with traditional under bridge inspection vehicles (UBIVs) is high-cost and laborious. To improve the inspection efficiency, the newly developed unmanned aerial vehicle (UAV) technique may provide a promising alternative solution. As the global navigation satellite system (GNSS) is not available under the bridge, the robust positioning of the UAV is still a challenge during fully autonomous inspections. Although accumulated works have attempted to utilize visual odometry to localize the UAV, their performance may easily deteriorate under simultaneously existed varying illumination and intense light noises. To cope with this issue, we design a ground–air mobile system and a dual-source positioning algorithm to enhance the robustness of the UAV’s positioning. Specifically, the ground part of the mobile system is a ground vehicle (GV) equipped with infrared markers, which provides the referential fiducials for the relative positioning of the UAV. To well identify the infrared markers, the spatial relationship between the UAV and the GV is first optimized by an observation model. Then, to guarantee the robustness of marker detection, both color image and infrared image are simultaneously captured, and a dual-source algorithm is proposed accordingly. To implement the algorithm, a candidate region containing the infrared markers is first identified by a deep convolutional neural network. Subsequently, this candidate region projects to the infrared image, and a searching–tracking–aiming algorithm robustly detects those infrared markers. Following the marker detection, the position of the UAV can be finally estimated by a perspective-3-point algorithm of the marker and an inertial measurement unit (IMU) compensation. To verify the performance of the developed positioning approach, we conduct various real-world experiments in challenging light conditions under the bridge. The results demonstrate that our ground–air system and dual-source algorithm can provide robust positioning for the UAV in intense light noises and varying illumination during the bridge inspection.

Robust Visual Positioning of the UAV for the under Bridge Inspection with a Ground Guided Vehicle

Localization, Planning, and Control of a UAV for Rapid Complete Coverage Bridge Inspection in Large-Scale Intermittent GPS Environments

UAV Navigation in Large-Scale GPS-denied Bridge Environments Using Fiducial Marker-Corrected Stereo Visual-Inertial Localisation

Vision-model-based Real-time Localization of Unmanned Aerial Vehicle for Autonomous Structure Inspection under GPS-denied Environment

Design and Development of a Multi-rotor Unmanned Aerial Vehicle System for Bridge Inspection

Vision-guided Unmanned Aerial System for Rapid Multiple-Type Damage Detection and Localization

A Ground-Based Optical System for Autonomous Landing of a Fixed Wing UAV

A Cooperative Positioning Approach of Unmanned Aerial Vehicles with Accuracy and Robustness.

Hybrid Camera Array-Based UAV Auto-Landing on Moving UGV in GPS-Denied Environment.

Real-Time Cross-View Image Matching and Camera Pose Determination for Unmanned Aerial Vehicles

Three-Dimensional Reconstruction and Damage Localization of Bridge Undersides Based on Close-Range Photography Using UAV

Localization Framework for Real-Time Uav Autonomous Landing: an On-Ground Deployed Visual Approach

An Integrated Algorithm Fusing UWB Ranging Positioning and Visual–Inertial Information for Unmanned Vehicles

Long-Range Vision-Based UAV-assisted Localization for Unmanned Surface Vehicles

Autonomous Ultrasonic Inspection Using Unmanned Aerial Vehicle

A Monocular Inertial UAV SLAM Algorithm Leveraging Feature Clustering

An Enhanced-LiDAR/UWB/INS Integrated Positioning Methodology for Unmanned Ground Vehicle in Sparse Environments

View Planning and Navigation Algorithms for Autonomous Bridge Inspection with UAVs

A Point-Line-Based SLAM Framework for UAV Close Proximity Transmission Tower Inspection

A UAV-based Explore-then-exploit System for Autonomous Indoor Facility Inspection and Scene Reconstruction

UAV coverage path planning algorithm for bridge detection