Abstract:The precise identification of faults is an essential component in the effective operation and maintenance of rotating machinery (RM). The increasing adoption of deep learning in this field is likely due to the vast amounts of automatically generated monitoring data and its robust ability to learn and detect errors effectively. Deep learning techniques generally demonstrate high efficacy, particularly when limited fault data is available or when employing a two-stage diagnostic approach, involving manual feature extraction followed by fault classification. To address these challenges, we introduce the Expansive Dual-Attention Fusion Transformer (EDAF-Transformer), which is trained through a semi-supervised approach using minimal labeled data. Our method begins with a detailed explanation of the foundational theories behind transformers and semi-supervised learning strategies. This establishes the basis of our approach to intelligent fault diagnosis, particularly under the constraints of raw vibration signals and limited labeled data availability. We then present our novel model, the EDAF-Transformer , which comprises two main components: the Expansive Dual-Attention Enhanced Modules and the 1-D Twin Global Self-Attention Transformer Encoder Module. The first component employs an Expansive Dual-branch Attention Enhanced Module (EDAEM) within a dual-branch attention architecture. This design effectively enlarges the receptive field, capturing both global and local features. The second component, the Twin Sparse Self-Attention Fusion Module (TSSAFM), integrates Global Sparse Self-Attention with Squeeze-and-Excitation (SE) attention. This module is designed to enhance feature encoding capabilities while simultaneously reducing computational demands. Furthermore, we implement an uncertainty self-training semi-supervised strategy focused on balanced unlabeled sample selection. This approach significantly enhances the generalizability and performance of the EDAF-Transformer . We extensively tested our semi-supervised fault diagnosis method on publicly available motor bearing data and a specially curated transmission shaft dataset. The results from these tests demonstrate that our method surpasses other intelligent fault diagnosis methods in effectiveness.

A novel time–frequency Transformer based on self–attention mechanism and its application in fault diagnosis of rolling bearings

A novel time-frequency Transformer based on self-attention mechanism and its application in fault diagnosis of rolling bearings

A novel rolling bearing fault diagnosis method based on time-series fusion transformer with interpretability analysis

Diagnosisformer: An efficient rolling bearing fault diagnosis method based on improved Transformer

Twins Transformer: Rolling Bearing Fault Diagnosis based on Cross-attention Fusion of Time and Frequency Domain Features

Multiscale Time-Frequency Sparse Transformer Based on Partly Interpretable Method for Bearing Fault Diagnosis

Rolling bearing fault diagnosis method using time-frequency information integration and multi-scale TransFusion network

A new rotating machinery fault diagnosis method based on the Time Series Transformer

Rolling Bearing Fault Monitoring for Sparse Time-Frequency Representation and Feature Detection Strategy

Rotating Machinery Fault Diagnosis Under Multiple Working Conditions via a Time-Series Transformer Enhanced by Convolutional Neural Network

A Time Series Transformer based method for the rotating machinery fault diagnosis

Intelligent fault diagnosis of rotating machine via Expansive dual-attention fusion Transformer enhanced by semi-supervised learning

A transformer model with enhanced feature learning and its application in rotating machinery diagnosis

An Adaptive Domain Adaptation Method for Rolling Bearings’ Fault Diagnosis Fusing Deep Convolution and Self-Attention Networks

Transfer learning-based channel attention enhancement network combined with Gramian angular domain field for fault diagnosis

A Deep Learning Method for Bearing Fault Diagnosis Based on Time-Frequency Image

Digital twin-driven partial domain adaptation network for intelligent fault diagnosis of rolling bearing

A Novel Fault Diagnosis Method of Rolling Bearing Based on Integrated Vision Transformer Model

Fault diagnosis of rolling bearing under complex working conditions based on time-frequency joint feature extraction-deep learning

A time series and deep fusion framework for rotating machinery fault diagnosis

Deep Learning Enabled Fault Diagnosis Using Time-Frequency Image Analysis of Rolling Element Bearings