Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery(RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Semisupervised Graph Convolution Deep Belief Network for Fault Diagnosis of Electormechanical System With Limited Labeled Data

Self-supervised Knowledge Mining from Unlabeled Data for Bearing Fault Diagnosis under Limited Annotations

Semi-supervised Multi-Scale Attention-Aware Graph Convolution Network for Intelligent Fault Diagnosis of Machine under Extremely-Limited Labeled Samples

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

A Fault Diagnosis Method for Rotating Machinery with Semi-supervised Graph Convolutional Network and Images Converted from Vibration Signals

A Semi-Supervised Intelligent Fault Diagnosis Method for Bearings Under Low Labeled Rates

Semi-supervised class incremental broad network for continuous diagnosis of rotating machinery faults with limited labeled samples

Rotating Machinery Fault Diagnosis Based on One-Dimensional Convolutional Neural Network and Modified Multi-Scale Graph Convolutional Network under Limited Labeled Data

Iterative Deep Graph Learning and Embedding for Industrial Fault Diagnosis with Limited Labeled Data

Deep representation clustering-based fault diagnosis method with unsupervised data applied to rotating machinery

Residual Attention Temporal Recurrent Network for Fault Diagnosis of Gearboxes under Limited Labeled Data

A hybrid classification autoencoder for semi-supervised fault diagnosis in rotating machinery

A Relation-Based Semisupervised Method for Gearbox Fault Diagnosis with Limited Labeled Samples.

An Intelligent Fault Diagnosis Based on Adversarial Generating Module and Semi-supervised Convolutional Neural Network

Semisupervised Deep Sparse Auto-Encoder With Local and Nonlocal Information for Intelligent Fault Diagnosis of Rotating Machinery

A Novel Unsupervised Directed Hierarchical Graph Network with Clustering Representation for Intelligent Fault Diagnosis of Machines

Multi-input Parallel Graph Neural Network for Semi-supervised Rolling Bearing Fault Diagnosis

Rotating machinery fault diagnosis based on feature extraction via an unsupervised graph neural network

Graph Convolutional Network-Based Method for Fault Diagnosis Using a Hybrid of Measurement and Prior Knowledge

A Relation-based Semi-supervised Method for Gearbox Fault Diagnosis with Limited Labeled Samples

Semi-Supervised Self-Correcting Graph Neural Network for Intelligent Fault Diagnosis of Rotating Machinery