Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery(RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

A Hybrid Supervised Approach for Fault Diagnosis Based on Temporal and Frequency Domains

Self-supervised Knowledge Mining from Unlabeled Data for Bearing Fault Diagnosis under Limited Annotations

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

A New Bearing Fault Diagnosis Method Based on Deep Transfer Network and Supervised Joint Matching

A New Framework Based on Supervised Joint Distribution Adaptation for Bearing Fault Diagnosis across Diverse Working Conditions

Fault diagnosis based on deep learning by extracting inherent common feature of multi-source heterogeneous data

Semi-Supervised Transfer Learning Method for Bearing Fault Diagnosis with Imbalanced Data

A novel self-supervised representation learning framework based on time-frequency alignment and interaction for mechanical fault diagnosis

Self-supervised Feature Extraction Via Time-Frequency Contrast for Intelligent Fault Diagnosis of Rotating Machinery

A hybrid classification autoencoder for semi-supervised fault diagnosis in rotating machinery

An Intelligent Hybrid Bearing Fault Diagnosis Method Based on Transformer and Domain Adaptation

A Hybrid Transfer Learning Method For Fault Diagnosis Of Machinery Under Variable Operating Conditions

Time-frequency supervised contrastive learning via pseudo-labeling: An unsupervised domain adaptation network for rolling bearing fault diagnosis under time-varying speeds

An Unsupervised Intelligent Fault Diagnosis System Based on Feature Transfer

A prior knowledge-enhanced self-supervised learning framework using time-frequency invariance for machinery intelligent fault diagnosis with small samples

Intelligent fault diagnosis of machinery based on hybrid deep learning with multi temporal correlation feature fusion

A Semi-Supervised Intelligent Fault Diagnosis Method for Bearings Under Low Labeled Rates

Interinstance and Intratemporal Self-Supervised Learning with Few Labeled Data for Fault Diagnosis

An Adaptive Domain Adaptation Method for Rolling Bearings’ Fault Diagnosis Fusing Deep Convolution and Self-Attention Networks

Deep Transfer Learning Network for Fault Diagnosis Under Variable Working Conditions.

Contrastive Learning Combining Frequency-Domain and Time-Domain Information for Intelligent Fault Diagnosis of Rotating Machinery