Abstract:The existing unmanned aerial vehicle (UAV)-based electric transmission line inspection systems generally adopt manual control and follow the predefined path, which reduces the efficiency and makes a high inspection cost. In this article, a UAV system with advanced embedded processors and binocular visual sensors is developed to generate guidance information from power lines in real-time and achieve automatic transmission line inspection. To realize 3-D autonomous perception of power lines, we first propose an end-to-end convolutional neural network (CNN) to extract complementary information from multilevel features and detect power lines with different pixel widths and orientations. Specifically, multilevel feature aggregation module fuses multilevel features within the same stage by learning the weight vector related to the content. The joint attention (JA) module is proposed to extract rich semantic information and suppress the background noises. Meanwhile, multistage detection results are fused to enhance the robustness of the proposed network. Subsequently, power lines are grouped according to the morphological characteristics of thinning detection results, and 3-D point sets of power lines are constructed based on the epipolar constraint of binocular images. Finally, the target point of current stereo images is generated by projecting 3-D power line points to the horizontal and vertical planes. The few-waypoint trajectory is generated based on continuous target points, and automatic inspection is finished with the proposed real-time motion planning strategy. Experimental results on four datasets show that the proposed power line detection method outperforms other state-of-the-art methods. The developed UAV platform and the proposed autonomous inspection strategy are evaluated in practical environments to validate the robustness and effectiveness.

Convolutional Neural Network Based Unmanned Ground Vehicle Control Via Deep Reinforcement Learning

Autonomous Driving with Human Guided Image Feature Extraction

End-to-end UAV Intelligent Training via Deep Reinforcement Learning

Self-Inspection Method of Unmanned Aerial Vehicles in Power Plants Using Deep Q-Network Reinforcement Learning

Robot Control in Human Environment Using Deep Reinforcement Learning and Convolutional Neural Network.

Human-Guided Reinforcement Learning With Sim-to-Real Transfer for Autonomous Navigation

Control method of autonomous mini-car based on deep Q-network

Evaluation of Reinforcement and Deep Learning Algorithms in Controlling Unmanned Aerial Vehicles

Deep Convolutional Neural Network enabled unmanned agricultural machine visual navigation system: architecture design, model optimization and empirical evaluation

Vision-Based Deep Reinforcement Learning of UAV-UGV Collaborative Landing Policy Using Automatic Curriculum

Deep Reinforcement Learning with Heuristic Corrections for UGV Navigation

Dynamic Obstacle Avoidance for USVs Using Cross-Domain Deep Reinforcement Learning and Neural Network Model Predictive Controller

An Algorithm of Complete Coverage Path Planning for Unmanned Surface Vehicle Based on Reinforcement Learning

Deep-reinforcement-learning-based UAV autonomous navigation and collision avoidance in unknown environments

A Deep Reinforcement Learning Based Approach for AGVs Path Planning

Deep Reinforcement Learning for Unmanned Aerial Vehicle-Assisted Vehicular Networks

Deep reinforcement learning and its application in autonomous fitting optimization for attack areas of UCAVs

A Data-Driven Real-Time Trajectory Planning and Control Methodology for UGVs Using LSTMRDNN

End-to-End Autonomous Driving Through Dueling Double Deep Q-Network

Power Line-Guided Automatic Electric Transmission Line Inspection System

A Vision Based Deep Reinforcement Learning Algorithm for UAV Obstacle Avoidance