Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery (RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

Predicting future laboratory fault friction through deep learning transformer models

Predicting Fault Slip via Transfer Learning

Prediction Model of Residual Load-Bearing Capacity of Composite Laminates Using Deep Learning

Machine Learning Predicts Laboratory Earthquakes

A dynamic informed deep learning method for future estimation of laboratory stick-slip

Machine Learning Predicts the Timing and Shear Stress Evolution of Lab Earthquakes Using Active Seismic Monitoring of Fault Zone Processes

Deep learning for laboratory earthquake prediction and autoregressive forecasting of fault zone stress

A Deep Learning Method for Damage Prognostics of Fiber-Reinforced Composite Laminates Using Acoustic Emission

Predicting Stick-Slips in Sheared Granular Fault Using Machine Learning Optimized Dense Fault Dynamics Data

Estimating Fault Friction from Seismic Signals in the Laboratory

Predicting the coefficient of friction in a sliding contact by applying machine learning to acoustic emission data

Prediction of the post‐failure behavior of rocks: Combining artificial intelligence and acoustic emission sensing

Characterizing Acoustic Signals and Searching for Precursors during the Laboratory Seismic Cycle Using Unsupervised Machine Learning

Attention network forecasts time-to-failure in laboratory shear experiments

Predicting laboratory earthquakes with machine learning

Physics informed neural network can retrieve rate and state friction parameters from acoustic monitoring of laboratory stick-slip experiments

Mechanical fault time series prediction by using EFMSAE-LSTM neural network

Machine Learning Predicts Earthquakes in the Continuum Model of a Rate‐And‐State Fault With Frictional Heterogeneities

Intelligent fault diagnosis of rotating machine via Expansive dual-attention fusion Transformer enhanced by semi-supervised learning

Research on Mechanical Fault Diagnosis and Prediction Technology Based on Deep Learning

Transformer Fault Prognosis Using Deep Recurrent Neural Network Over Vibration Signals