Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery(RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Consistency Regularization Auto-Encoder Network for Semi-Supervised Process Fault Diagnosis

Discriminant Autoencoder for Feature Extraction in Fault Diagnosis

Semi-supervised Fault Classification Based on Dynamic Sparse Stacked Auto-Encoders Model

Robust Self-Supervised Model and Its Application for Fault Detection

A Review on Autoencoder Based Representation Learning for Fault Detection and Diagnosis in Industrial Processes

Adaptive Positive Semidefinite Matrix-Based Contribution For Nonlinear Process Diagnosis

STAGED: A Spatial-Temporal Aware Graph Encoder–Decoder for Fault Diagnosis in Industrial Processes

Parallel Label Consistent KSVD-Stacked Autoencoder for Industrial Process Fault Diagnosis

Nonlinear Dynamic System Based on SAE-LDS Model for Fault Diagnosis

Feature-Aligned Stacked Autoencoder: A Novel Semisupervised Deep Learning Model for Pattern Classification of Industrial Faults

Residual Squeeze-and-excitation Convolutional Auto-Encoder for Fault Detection and Diagnosis in Complex Industrial Processes

Weighted Time Series Fault Diagnosis Based on a Stacked Sparse Autoencoder

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

Unsupervised Learning for Machinery Adaptive Fault Detection Using Wide-Deep Convolutional Autoencoder with Kernelized Attention Mechanism

An Intelligent Fault Detection Method Based on Sparse Auto-Encoder for Industrial Process Systems: A Case Study on Tennessee Eastman Process Chemical System

Fault Diagnosis Using Improved Discrimination Locality Preserving Projections Integrated With Sparse Autoencoder

Autoencoder embedded dictionary learning for nonlinear industrial process fault diagnosis

A novel self-training semi-supervised deep learning approach for machinery fault diagnosis

Explainable Artificial Intelligence for Fault Diagnosis of Industrial Processes

Sparsity and Manifold Regularized Convolutional Auto-Encoders-based Feature Learning for Fault Detection of Multivariate Processes

Feature-level consistency regularized Semi-supervised scheme with data augmentation for intelligent fault diagnosis under small samples