Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery(RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Semi-supervised meta-learning networks with squeeze-and-excitation attention for few-shot fault diagnosis

Self-attention Metric Learning Based on Multi-Scale Feature Fusion for Few-shot Fault Diagnosis

Self-Attention Metric Learning Based on Multiscale Feature Fusion for Few-Shot Fault Diagnosis

Self-Adaptation Graph Attention Network via Meta-Learning for Machinery Fault Diagnosis With Few Labeled Data

Attention-based Deep Meta-Transfer Learning for Few-Shot Fine-Grained Fault Diagnosis

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

A novel meta-transfer learning approach via convolutional multi-head self-attention network for few-shot fault diagnosis

An enhanced meta-learning network with sensitivity penalty for cross-domain few-shot fault diagnosis

Few-shot Fault Diagnosis of Turnout Switch Machine Based on Flexible Semi-Supervised Meta-Learning Network

Self-supervised signal representation learning for machinery fault diagnosis under limited annotation data

Feature-level consistency regularized Semi-supervised scheme with data augmentation for intelligent fault diagnosis under small samples

A novel self-training semi-supervised deep learning approach for machinery fault diagnosis

A Mechanical Fault Diagnosis Model with Semi-Supervised Variational Autoencoder Based on Long Short-Term Memory Network

Few-shot bearing fault diagnosis based on meta-learning with discriminant space optimization

A Meta-learning Method for Few-shot Bearing Fault Diagnosis under Variable Working Conditions

A Meta-Learning Network with Anti-Interference for Few-Shot Fault Diagnosis

An Intelligent Fault Diagnosis Based on Adversarial Generating Module and Semi-supervised Convolutional Neural Network

Metric-based Meta-Learning Model for Few-Shot Fault Diagnosis under Multiple Limited Data Conditions

Few-Shot Learning for Fault Diagnosis: Semi-Supervised Prototypical Network with Pseudo-Labels

Adaptive Meta Transfer Learning with Efficient Self-Attention for Few-Shot Bearing Fault Diagnosis

Semi-Supervised Prototype Network with CBAM and Data Selector for Few-Shot Bearing Fault Diagnosis