Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery (RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Transformer fault diagnosis using continuous sparse autoencoder

Convolutional neural networks applied to dissolved gas analysis for power transformers condition monitoring

Generalized Transformer in Fault Diagnosis of Tennessee Eastman Process

A Feature Selection and Ensemble Learning Based Methodology for Transformer Fault Diagnosis

Semi-supervised Fault Classification Based on Dynamic Sparse Stacked Auto-Encoders Model

Power Transformer Fault Diagnosis Based on Ensemble Learning

Stacked Sparse Autoencoder with PCA and SVM for Data-Based Line Trip Fault Diagnosis in Power Systems

A Methodology for Transformer Fault Diagnosis Based on the Feature Extraction from DGA Data

Weighted Time Series Fault Diagnosis Based on a Stacked Sparse Autoencoder

Transformer fault diagnosis based on adversarial generative networks and deep stacked autoencoder

A Methodology to Diagnose Transformer Faults Based on Principal Components Analysis and Artificial Neural Network

Online Fault Diagnosis of Power Transformer with Temporal and Spatial Features

Application of Super SAB ANN Model for Transformer Fault Diagnosis

Adaptive Transfer Learning Based on a Two-Stream Densely Connected Residual Shrinkage Network for Transformer Fault Diagnosis over Vibration Signals

Convolutional Neural Network-Based Transformer Fault Diagnosis Using Vibration Signals

Adaptive Diagnosis for Transformer With Unknown Faults Based on Antenna-Augmented RFID Sensor and Deep Learning

An Efficient Anomaly Detection Method for Industrial Control Systems: Deep Convolutional Autoencoding Transformer Network

A Novel Fault Diagnosis Method for a Power Transformer Based on Multi-Scale Approximate Entropy and Optimized Convolutional Networks

Intelligent fault diagnosis of rotating machine via Expansive dual-attention fusion Transformer enhanced by semi-supervised learning

Method of Inter-Turn Fault Detection for Next-Generation Smart Transformers Based on Deep Learning Algorithm

Data-Driven Feature Extraction-Transformer: A Hybrid Fault Diagnosis Scheme Utilizing Acoustic Emission Signals