Autonomous flight strategy of an unmanned aerial vehicle with multimodal information for autonomous inspection of overhead transmission facilities

Munsu Jeon,Joonhyeok Moon,Siheon Jeong,Ki‐Yong Oh
DOI: https://doi.org/10.1111/mice.13188
IF: 10.066
2024-03-13
Computer-Aided Civil and Infrastructure Engineering
Abstract:This study proposes an innovative method for achieving autonomous flight to inspect overhead transmission facilities. The proposed method not only integrates multimodal information from novel sensors but also addresses three essential aspects to overcome the existing limitations in autonomous flights of an unmanned aerial vehicle (UAV). First, a novel deep neural network architecture titled the rotational bounding box with a multi‐level feature pyramid transformer is introduced for accurate object detection. Second, a safe autonomous method for the transmission tower approach is proposed by using multimodal information from an optical camera and 3D light detection and ranging. Third, a simple yet accurate control strategy is proposed for tracking transmission lines without necessitating gimbal control because it keeps the UAV's altitude in sync with that of the transmission lines. Systematic analyses conducted in both virtual and real‐world environments confirm the effectiveness of the proposed method. The proposed method not only enhances the performance of autonomous flight but also provides a safe operating platform for inspection personnel.
transportation science & technology,construction & building technology,computer science, interdisciplinary applications,engineering, civil
What problem does this paper attempt to address?