Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery (RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

DEViT: Deformable Convolution-Based Vision Transformer for Bearing Fault Diagnosis

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

Local feature expansion Vision Transformer model for bearing fault diagnosis under noise environments

Multi-channel Fused Vision Transformer Network for Bearing Fault Diagnosis under Different Working Conditions

A Siamese Vision Transformer for Bearings Fault Diagnosis

Bearing Fault Diagnosis Based on an Enhanced Image Representation Method of Vibration Signal and Conditional Super Token Transformer

Diagnosisformer: An efficient rolling bearing fault diagnosis method based on improved Transformer

Residual Attention Single-Head Vision Transformer Network for Rolling Bearing Fault Diagnosis in Noisy Environments

Intelligent fault diagnosis of rotating machine via Expansive dual-attention fusion Transformer enhanced by semi-supervised learning

Intelligent Bearing Fault Diagnosis Based on Multivariate Symmetrized Dot Pattern and LEG Transformer

A lightweight multi-feature fusion vision transformer bearing fault diagnosis method with strong local sensing ability in complex environments

1D-DCTN: 1-D Deformable Convolutional Transformer Network for Multi-Signal Fault Diagnosis

A transformer model with enhanced feature learning and its application in rotating machinery diagnosis

A Vision Transformer-Based Approach to Bearing Fault Classification via Vibration Signals

Defect-aware transformer network for intelligent visual surface defect detection

Variational Attention-Based Interpretable Transformer Network for Rotary Machine Fault Diagnosis

Rolling Bearing Fault Diagnosis Based on SVD-GST Combined with Vision Transformer

Convolution Enabled Transformer Via Random Contrastive Regularization for Rotating Machinery Diagnosis under Time-Varying Working Conditions

A High-Precision Aeroengine Bearing Fault Diagnosis Based on Spatial Enhancement Convolution and Vision Transformer

Transformer-Based Bearing Fault Detection using Temporal Decomposition Attention Mechanism

Signal-Transformer: A robust and interpretable method for rotating machinery intelligent fault diagnosis under variable operating conditions