Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery(RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Semi-supervised Learning of Decision: Making for Parts Faults to System-Level Failures Diagnosis in Avionics System

Evaluating Semi-supervised Learning for Automated Fault Detection and Diagnosis of Air Handling Units

Data Mining–based Intelligent Fault Diagnostics for Integrated System Health Management to Avionics

Fault Diagnosis of Aeroengine Control System Sensor Based on Optimized and Fused Multidomain Feature.

Semi-supervised hierarchical attribute representation learning via multi-layer matrix factorization for machinery fault diagnosis

Statistical Characterization of Semi-Supervised Neural Networks for Fault Detection and Diagnosis of Air Handling Units

Intelligent Fault Diagnosis of Rotating Machine Via Expansive Dual-Attention Fusion Transformer Enhanced by Semi-Supervisedlearning

A novel self-training semi-supervised deep learning approach for machinery fault diagnosis

Aircraft Fault Diagnosis And Decision System Based On Improved Artificial Neural Networks

An Intelligent Fault Diagnosis Based on Adversarial Generating Module and Semi-supervised Convolutional Neural Network

Semisupervised fault diagnosis of aeroengine based on denoising autoencoder and deep belief network

A novel aircraft engine fault diagnostic and prognostic system based on SVM

Hybrid multi-mode machine learning-based fault diagnosis strategies with application to aircraft gas turbine engines

Avionics Module Fault Diagnosis Algorithm Based on Hybrid Attention Adaptive Multi-Scale Temporal Convolution Network

Data-Driven Fault Diagnosis Techniques: Non-Linear Directional Residual vs. Machine-Learning-Based Methods

Semi-supervised joint adaptation transfer network with conditional adversarial learning for rotary machine fault diagnosis

A multi-channel data-based fault diagnosis method integrating deep learning strategy for aircraft sensor system

Review on Deep Learning Based Fault Diagnosis

Industrial fault diagnosis based on active learning and semi-supervised learning using small training set

Framework for Offline Data-Driven Aircraft Fault Diagnosis

Fault Diagnosis of Avionics System Based on Parameter Optimized Support Vector Machine