Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery(RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

A novel deep learning model based on target transformer for fault diagnosis of chemical process

Generalized Transformer in Fault Diagnosis of Tennessee Eastman Process

A Novel Transformer-Based Model with Large Kernel Temporal Convolution for Chemical Process Fault Detection

Deep Learning With Tensor Factorization Layers For Sequential Fault Diagnosis And Industrial Process Monitoring

Deep learning based transformer fault diagnosis method

A Novel LSTM-1DCNN-based Deep Network for Fault Diagnosis in Chemical Process

A novel transformer-based multi-variable multi-step prediction method for chemical process fault prognosis

Fault Diagnosis of the Dynamic Chemical Process Based on the Optimized CNN-LSTM Network

A Novel Fault Detection and Identification Method for Complex Chemical Processes Based on OSCAE and CNN

A Novel Triage-Based Fault Diagnosis Method for Chemical Process

Intelligent Fault Diagnosis for Chemical Processes Using Deep Learning Multimodel Fusion

A novel fault diagnosis method for imbalanced datasets based on MCNN‐Transformer model in industrial processes

A novel fault diagnosis framework empowered by LSTM and attention: A case study on the Tennessee Eastman process

Deep Convolutional Neural Network Model Based Chemical Process Fault Diagnosis

A novel fault diagnosis method based on CNN and LSTM and its application in fault diagnosis for complex systems

A Residual Autoencoder-based Transformer for Fault Detection of Multivariate Processes

Deep Learning Based Fault Diagnosis for Chemical Process with Statistical Feature Fusion

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

A Novel Deep Learning Based Fault Diagnosis Approach for Chemical Process with Extended Deep Belief Network.

Unsupervised Transfer Learning for Fault Diagnosis Across Similar Chemical Processes

Integrating feature optimization using a dynamic convolutional neural network for chemical process supervised fault classification