Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery (RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Transformer-based meta learning method for bearing fault identification under multiple small sample conditions

Rolling Bearing Fault Diagnosis with Variable Load and Few Samples Based on Multifeature Fusion Meta-Learning

A Meta-learning Method for Few-shot Bearing Fault Diagnosis under Variable Working Conditions

Lightweight Convolutional Transformers Enhanced Meta Learning for Compound Fault Diagnosis of Industrial Robot

A Meta-Learning Method for Electric Machine Bearing Fault Diagnosis under Varying Working Conditions with Limited Data

A hierarchical Transformer-based adaptive metric and joint-learning network for few-shot rolling bearing fault diagnosis

Digital twin-assisted enhanced meta-transfer learning for rolling bearing fault diagnosis

Semi-Supervised Temporal Meta-Learning Framework for Wind Turbine Bearing Fault Diagnosis Under Limited Annotation Data

Interpretable multi-domain meta-transfer learning for few-shot fault diagnosis of rolling bearing under variable working conditions

A Siamese Vision Transformer for Bearings Fault Diagnosis

Multi-label Fault Diagnosis of Rolling Bearing Based on Meta-Learning

Few-Shot Bearing Fault Diagnosis Based on Model-Agnostic Meta-Learning

A New Meta-transfer Learning Method with Freezing Operation for Few-shot Bearing Fault Diagnosis

An Information Fusion-Based Meta Transfer Learning Method for Few-Shot Fault Diagnosis under Varying Operating Conditions

Generalized MAML for few-shot cross-domain fault diagnosis of bearing driven by heterogeneous signals

Few-shot bearing fault diagnosis based on meta-learning with discriminant space optimization

A novel method based on meta-learning for bearing fault diagnosis with small sample learning under different working conditions

FaultFormer: Pretraining Transformers for Adaptable Bearing Fault Classification

Intelligent fault diagnosis of rotating machine via Expansive dual-attention fusion Transformer enhanced by semi-supervised learning

An Intelligent Multi-Local Model Bearing Fault Diagnosis Method Using Small Sample Fusion

Few-Shot Cross-Domain Fault Diagnosis of Bearing Driven By Task-Supervised ANIL