Abstract:Transformer model is being gradually studied and applied in bearing fault diagnosis tasks, which can overcome the feature extraction defects caused by long-term dependencies in convolution neural network (CNN) and recurrent neural network (RNN). To optimize the structure of existing transformer-like methods and improve the diagnostic accuracy, we proposed a novel method based on the multiscale time-frequency sparse transformer (MTFST) in this paper. First, a novel tokenizer based on shot-time Fourier transform (STFT) is designed, which processes the 1D format raw signals into 2D format discrete time-frequency sequences in the embedding space. Second, a sparse self-attention mechanism is designed to eliminate the feature mapping defect in naive self-attention mechanism. Then, the novel encoder-decoder structure is presented, the multiple encoders are employed to extract the hidden feature of different time-frequency sequences obtained by STFT with different window widths, and the decoder is used to remap the deep information and connect to the classifier for discriminating fault types. The proposed method is tested in the XJTU-SY bearing dataset and self-made experiment rig dataset, and the following work is conducted. The influences of hyperparameters on diagnosis accuracy and number of parameters are analysed in detail. The weights of the attention mechanism (AM) are visualized and analysed to study the interpretability, which explains the partly working pattern of the network. In the comparison test with other existing CNN, RNN, and transformer models, the diagnosis accuracy of different methods is statistically analysed, feature vectors are presented via the t-distributed stochastic neighbor embedding (t-SNE) method, and the proposed MTFST obtains the best accuracy and feature distribution form. The results demonstrate the effectiveness and superiority of the proposed method in bearing fault diagnosis.

Hierarchical spiking neural network auditory feature based dry-type transformer fault diagnosis using convolutional neural network

Data-Driven Feature Extraction-Transformer: A Hybrid Fault Diagnosis Scheme Utilizing Acoustic Emission Signals

Convolutional Neural Network-Based Transformer Fault Diagnosis Using Vibration Signals

Convolutional neural networks applied to dissolved gas analysis for power transformers condition monitoring

Neural-transformer: A Brain-Inspired Lightweight Mechanical Fault Diagnosis Method under Noise

Multiscale Time-Frequency Sparse Transformer Based on Partly Interpretable Method for Bearing Fault Diagnosis

Rotating Machinery Fault Diagnosis Under Multiple Working Conditions via a Time-Series Transformer Enhanced by Convolutional Neural Network

Motor Fault Diagnosis Based on Short-time Fourier Transform and Convolutional Neural Network

Adaptive Diagnosis for Transformer With Unknown Faults Based on Antenna-Augmented RFID Sensor and Deep Learning

A Fault Diagnosis Method of Power Transformer Based on Cost Sensitive One-Dimensional Convolution Neural Network

A new rotating machinery fault diagnosis method based on the Time Series Transformer

Transformer Winding Fault Diagnosis Using Vibration Image and Deep Learning

Deep Convolutional Neural Network Using Transfer Learning for Fault Diagnosis

A Comparison of CNN-Based Transformer Fault Diagnosis Methods Based on Voiceprint Signal

A Fault Diagnosis Scheme for Rotating Machinery Using Hierarchical Symbolic Analysis and Convolutional Neural Network

Intelligent Bearing Fault Diagnosis Based on Feature Fusion of One-Dimensional Dilated CNN and Multi-Domain Signal Processing

Adaptive Transfer Learning Based on a Two-Stream Densely Connected Residual Shrinkage Network for Transformer Fault Diagnosis over Vibration Signals

Transformer fault diagnosis model based on FI-CNN method

TDANet: A Novel Temporal Denoise Convolutional Neural Network With Attention for Fault Diagnosis

Fault Diagnosis Method and Application Based on Multi-scale Neural Network and Data Enhancement for Strong Noise

Multi-scale Transformer-CNN domain adaptation network for complex processes fault diagnosis