Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery(RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Few-shot Learning under Domain Shift: Attentional Contrastive Calibrated Transformer of Time Series for Fault Diagnosis under Sharp Speed Variation

Multi-channel Calibrated Transformer with Shifted Windows for Few-Shot Fault Diagnosis under Sharp Speed Variation

Domain Discrepancy-guided Contrastive Feature Learning for Few-shot Industrial Fault Diagnosis under Variable Working Conditions

Cross Attention Transformer-Based Domain Adaptation: A Novel Method for Fault Diagnosis of Rotating Machinery with High Generalizability and Alignment Capability

Hybrid Augmented Network with Balance Domain Window for Few-Shot Fault Diagnosis under Sharp Speed Variation

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

CLFormer: A Lightweight Transformer Based on Convolutional Embedding and Linear Self-Attention With Strong Robustness for Bearing Fault Diagnosis Under Limited Sample Conditions

A Novel Transformer-based Few-Shot Learning Method for Intelligent Fault Diagnosis with Noisy Labels under Varying Working Conditions

Interpretable Domain Adaptation Transformer: a Transfer Learning Method for Fault Diagnosis of Rotating Machinery

Twins Transformer: Rolling Bearing Fault Diagnosis based on Cross-attention Fusion of Time and Frequency Domain Features

A Simple Data Augmentation Algorithm and a Self-Adaptive Convolutional Architecture for Few-Shot Fault Diagnosis under Different Working Conditions

Few-shot Learning-based Fault Diagnosis Using Prototypical Contrastive Based Domain Adaptation under Variable Working Conditions

Deep Contrastive Transfer Learning for Rotating Machinery Fault Diagnosis

A Lightweight and Rapidly Converging Transformer Based on Separable Linear Self-Attention for Fault Diagnosis

Simultaneous-fault diagnosis considering time series with a deep learning transformer architecture for air handling units

FFT-Trans: Enhancing Robustness in Mechanical Fault Diagnosis with Fourier Transform-Based Transformer under Noisy Conditions

Rotating Machinery Fault Diagnosis Under Multiple Working Conditions via a Time-Series Transformer Enhanced by Convolutional Neural Network

TScatNet: an Interpretable Cross-Domain Intelligent Diagnosis Model with Antinoise and Few-Shot Learning Capability

FS-PTL: A unified few-shot partial transfer learning framework for partial cross-domain fault diagnosis under limited data scenarios

Deep Multilayer Sparse Regularization Time-Varying Transfer Learning Networks with Dynamic Kullback–Leibler Divergence Weights for Mechanical Fault Diagnosis

Fault Impulse Inference and Cyclostationary Approximation: A feature-interpretable intelligent fault detection method for few-shot unsupervised domain adaptation