Abstract:To address power transmission lines (PTLs) traveling through complex environments leading to misdetections and omissions in fitting recognition using cameras, we propose a fitting recognition approach combining depth-attention YOLOv5 and prior synthetic dataset to improve the validity of fitting recognition. First, datasets with inspection features are automatically synthesized based on prior series data, achieving better results with a smaller data volume for the deep learning model and reducing the cost of obtaining fitting datasets. Next, a unique data collection mode is proposed using a developed flying-walking power transmission line inspection robot (FPTLIR) as the acquisition platform. The obtained image data in this collection mode has obvious time-space, stability, and depth difference, fusing the two data types in the deep learning model to improve the accuracy. Finally, a depth-attention mechanism is proposed to change the attention on the images with depth information, reducing the probability of model misdetection and omission. Test field experiments results show that compared with YOLOv5, the mAP5095 (mean average precision on step size 0.05 for thresholds from 0.5 to 0.95) of our depth-attention YOLOv5 model for fitting is 68.1%, the recall is 98.3%, and the precision is 98.3%. Among them, AP, recall, and precision increased by 5.2%, 4.8%, and 4.1%, respectively. Test field experiments verify the feasibility of the depth-attention YOLOv5. Line field experiments results show that the mAP5095 of our depth-attention YOLOv5 model for fittings is 64.6%, and the mAPs of each class are improved compared with other attention mechanisms. The inference speed of depth-attention YOLOv5 is 3 ms slower than the standard YOLOv5 model and 10 ms to 15 ms faster than other attention mechanisms, verifying the validity of the depth-attention YOLOv5. The proposed approach improves the accuracy of the fitting recognition on PTLs, providing a recognition and localization basis for the automation and intelligence of inspection robots.

Object recognition for power equipment via human-level concept learning

Multi-label image recognition for electric power equipment inspection based on multi-scale dynamic graph convolution network

High-resolution power equipment recognition based on improved self-attention

A Fitting Recognition Approach Combining Depth-Attention YOLOv5 and Prior Synthetic Dataset

High-level Object Affordance Recognition.

LiDAR Point Cloud Recognition and Visualization with Deep Learning for Overhead Contact Inspection

Algorithms for Object Detection in Substations

Beyond Object Recognition: A New Benchmark towards Object Concept Learning

Human Behavior Recognition for Substation Operation and Maintenance

Intelligent Inspection Robot Scene Recognition under Convolutional Neural Network

Image Analysis Method of Substation Equipment Status Based on Cross‐Modal Learning

Target Detection of Substation Electrical Equipment from Infrared Images Using an Improved Faster Regions with Convolutional Neural Network Features Algorithm

Object detection and recognition of intelligent service robot based on deep learning

Research on power equipment recognition method based on image processing

ID-Net: an improved mask R-CNN model for intrusion detection under power grid surveillance

Automatic Fault Diagnosis of Infrared Insulator Images Based on Image Instance Segmentation and Temperature Analysis

Attentive multi-scale aggregation based action recognition and its application in power substation operation training

Intelligent Video Recognition of Violation Behavior in Substation Site Based on Mask R-CNN

A machine learning based intelligent vision system for autonomous object detection and recognition

Research on Fault Detection Algorithm of Electrical Equipment Based on Neural Network