Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery (RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Semi-Supervised Fault Diagnosis Method Based on Dual-Stream Attention Cyclic Auto-Encoder for Rotating Components With Low Label Rate

Boosting efficient attention assisted cyclic adversarial auto-encoder for rotating component fault diagnosis under low label rates

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

Semisupervised Deep Sparse Auto-Encoder With Local and Nonlocal Information for Intelligent Fault Diagnosis of Rotating Machinery

An Automatic and Robust Features Learning Method for Rotating Machinery Fault Diagnosis Based on Contractive Autoencoder.

A hybrid classification autoencoder for semi-supervised fault diagnosis in rotating machinery

Multi-Scale Recursive Semi-Supervised Deep Learning Fault Diagnosis Method with Attention Gate

A fault diagnosis framework for rotating machinery of marine equipment: A semi-supervised learning framework based on contractive stacked autoencoder

Intelligent fault diagnosis of rotating machine via Expansive dual-attention fusion Transformer enhanced by semi-supervised learning

Deep multiple auto-encoder with attention mechanism network: A dynamic domain adaptation method for rotary machine fault diagnosis under different working conditions

A Fault Diagnosis Method for Mechanical Rotating Components Based on Automatic Learning of Pseudo Labels

Unsupervised Learning for Machinery Adaptive Fault Detection Using Wide-Deep Convolutional Autoencoder with Kernelized Attention Mechanism

Deep Self-Supervised Domain Adaptation Network for Fault Diagnosis of Rotating Machine With Unlabeled Data

Deep Coupling Autoencoder for Fault Diagnosis with Multimodal Sensory Data

An Unsupervised Deep Feature Learning Model Based on Parallel Convolutional Autoencoder for Intelligent Fault Diagnosis of Main Reducer

Dual Contrastive Learning for Semi-Supervised Fault Diagnosis Under Extremely Low Label Rate

Deep representation clustering-based fault diagnosis method with unsupervised data applied to rotating machinery

A Hierarchical Sparse Discriminant Autoencoder for Bearing Fault Diagnosis

A New Deep Transfer Learning Network Based on Convolutional Auto-Encoder for Mechanical Fault Diagnosis

A Semi-Supervised Intelligent Fault Diagnosis Method for Bearings Under Low Labeled Rates

Deep Laplacian Auto-encoder and Its Application into Imbalanced Fault Diagnosis of Rotating Machinery