Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery (RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

DRSwin-ST: An intelligent fault diagnosis framework based on dynamic threshold noise reduction and sparse transformer with Shifted Windows

IRMSwin-T: A lightweight shifted windows transformer based on inverted residual structure and residual multi-layer perceptron for rolling bearing fault diagnosis

Multiscale dilated convolution and swin-transformer for small sample gearbox fault diagnosis

MFSFormer: A Novel End-to-End Rotating Machinery Fault Diagnosis Framework for Noise and Small Samples

A novel collaborative bearing fault diagnosis method based on multi-scale dynamic fusion network under speed fluctuating condition

TSoft-Net: A novel transfer soft thresholding network based on self-attention for intelligent fault diagnosis of rotating machinery

Multi-scale deep residual shrinkage networks with a hybrid attention mechanism for rolling bearing fault diagnosis

Data-Driven Feature Extraction-Transformer: A Hybrid Fault Diagnosis Scheme Utilizing Acoustic Emission Signals

SMLFormer: A Lightweight and Robust Framework for Intelligent In-Transit Diagnosis

A Fault Diagnosis Method for Motor Vibration Signals Incorporating Swin Transformer with Locally Sensitive Hash Attention

Transformer assisted by DSC and BiLSTM for bearing fault pattern recognition under strong noise interference

Bearing Fault Diagnosis by Sparse Frequency Spiral Spectrum Driven NAF-LDM under Strong Noise and Small Samples

An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis

Diagnosisformer: An efficient rolling bearing fault diagnosis method based on improved Transformer

A novel time–frequency Transformer based on self–attention mechanism and its application in fault diagnosis of rolling bearings

Intelligent fault diagnosis of rotating machine via Expansive dual-attention fusion Transformer enhanced by semi-supervised learning

A novel time-frequency Transformer based on self-attention mechanism and its application in fault diagnosis of rolling bearings

Adaptive Transfer Learning Based on a Two-Stream Densely Connected Residual Shrinkage Network for Transformer Fault Diagnosis over Vibration Signals

Multiscale Time-Frequency Sparse Transformer Based on Partly Interpretable Method for Bearing Fault Diagnosis

Intelligent Fault Diagnosis Across Varying Working Conditions Using Triplex Transfer LSTM for Enhanced Generalization

Rolling bearing fault diagnosis method using time-frequency information integration and multi-scale TransFusion network