Abstract:With the development of the smart grid, the traditional defect detection methods in transmission lines are gradually shifted to the combination of robots or drones and deep learning technology to realize the automatic detection of defects, avoiding the risks and computational costs of manual detection. Lightweight embedded devices such as drones and robots belong to small devices with limited computational resources, while deep learning mostly relies on deep neural networks with huge computational resources. And semantic features of deep networks are richer, which are also critical for accurately classifying morphologically similar defects for detection, helping to identify differences and classify transmission line components. Therefore, we propose a method to obtain advanced semantic features even in shallow networks. Combined with transfer learning, we change the image features (e.g., position and edge connectivity) under self-supervised learning during pre-training. This allows the pre-trained model to learn potential semantic feature representations rather than relying on low-level features. The pre-trained model then directs a shallow network to extract rich semantic features for downstream tasks. In addition, we introduce a category semantic fusion module (CSFM) to enhance feature fusion by utilizing channel attention to capture global and local information lost during compression and extraction. This module helps to obtain more category semantic information. Our experiments on a self-created transmission line defect dataset show the superiority of modifying low-level image information during pre-training when adjusting the number of network layers and embedding of the CSFM. The strategy demonstrates generalization on the publicly available PASCAL VOC dataset. Finally, compared with state-of-the-art methods on the synthetic fog insulator dataset (SFID), the strategy achieves comparable performance with much smaller network depths.

A Global-Features and Local-Features-Jointly Fused Deep Semantic Learning Framework for Error Detection of Machine Translation

An Automatic Error Detection Method for Machine Translation Results Via Deep Learning

Semantic and traditional feature fusion for software defect prediction using hybrid deep learning model

SeSICL: Semantic and Structural Integrated Contrastive Learning for Knowledge Graph Error Detection

Learning to Detect Unacceptable Machine Translations for Downstream Tasks

SemMT: A Semantic-based Testing Approach for Machine Translation Systems

Learning Semantic Alignment Using Global Features and Multi-scale Confidence

A Novel Strategy for Extracting Richer Semantic Information Based on Fault Detection in Power Transmission Lines

Automated Testing for Machine Translation Via Constituency Invariance

Software Fault Localization Based on Multi-objective Feature Fusion and Deep Learning

A test-free semantic mistakes localization framework in Neural Code Translation

Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approach

Let's Fuse Step by Step: A Generative Fusion Decoding Algorithm with LLMs for Multi-modal Text Recognition

Analyzing the impact of deep learning algorithms and fuzzy logic approach for remote English translation

SemSeq4FD: Integrating global semantic relationship and local sequential order to enhance text representation for fake news detection

Concurrent Linguistic Error Detection (CLED) for Large Language Models

DeepFD: Automated Fault Diagnosis and Localization for Deep Learning Programs

Enhancing Machine Translation Quality Estimation via Fine-Grained Error Analysis and Large Language Model

Improving Multilingual Neural Machine Translation by Utilizing Semantic and Linguistic Features

A Lightweight Spatial and Temporal Multi-Feature Fusion Network for Defect Detection

Collaborative deep learning framework for fault diagnosis in distributed complex systems