Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery(RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Intelligent Fault Diagnosis of Rotating Machinery Using Locally Connected Restricted Boltzmann Machine in Big Data Era

Fault Diagnosis Method Based on Improved Deep Boltzmann Machines

An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

Fault Diagnosis for Rotating Machinery Using Vibration Measurement Deep Statistical Feature Learning

A Novel Fault Feature Selection and Diagnosis Method for Rotating Machinery with SI-IR2CMSE and SSGMM-SR

Intelligent fault diagnosis of rotating machinery based on deep learning with feature selection

Robust Discriminant Latent Variable Manifold Learning for Rotating Machinery Fault Diagnosis

A Feature Fusion Deep Belief Network Method for Intelligent Fault Diagnosis of Rotating Machinery.

Intelligent Fault Diagnosis Method for Rotating Machinery Based on Recurrence Binary Plot and DSD-CNN

Intelligent Fault Diagnosis of Rotating Machinery under Variable Working Conditions Based on Deep Transfer Learning with Fusion of Local and Global Time–frequency Features

Interactive spatiotemporal LSTM approach for enhanced industrial fault diagnosis

A Novel Unsupervised Deep Learning Network for Intelligent Fault Diagnosis of Rotating Machinery

Deep residual learning-based fault diagnosis method for rotating machinery

A New Local-Global Deep Neural Network and Its Application in Rotating Machinery Fault Diagnosis

A Survey on Fault Diagnosis of Rotating Machinery Based on Machine Learning

An Integrated Multi-Sensor Fusion-Based Deep Feature Learning Approach for Rotating Machinery Diagnosis

Intelligent Fault Diagnosis of Rolling Bearings Based on LSTM with Large Margin Nearest Neighbor Algorithm

Intelligent Diagnosis of Rotating Machinery Based on Optimized Adaptive Learning Dictionary and 1DCNN

Feature Space Transformation for Fault Diagnosis of Rotating Machinery under Different Working Conditions

An Intelligent Fault Diagnosis Approach Based on Transfer Learning from Laboratory Bearings to Locomotive Bearings