Abstract:Transformer model is being gradually studied and applied in bearing fault diagnosis tasks, which can overcome the feature extraction defects caused by long-term dependencies in convolution neural network (CNN) and recurrent neural network (RNN). To optimize the structure of existing transformer-like methods and improve the diagnostic accuracy, we proposed a novel method based on the multiscale time-frequency sparse transformer (MTFST) in this paper. First, a novel tokenizer based on shot-time Fourier transform (STFT) is designed, which processes the 1D format raw signals into 2D format discrete time-frequency sequences in the embedding space. Second, a sparse self-attention mechanism is designed to eliminate the feature mapping defect in naive self-attention mechanism. Then, the novel encoder-decoder structure is presented, the multiple encoders are employed to extract the hidden feature of different time-frequency sequences obtained by STFT with different window widths, and the decoder is used to remap the deep information and connect to the classifier for discriminating fault types. The proposed method is tested in the XJTU-SY bearing dataset and self-made experiment rig dataset, and the following work is conducted. The influences of hyperparameters on diagnosis accuracy and number of parameters are analysed in detail. The weights of the attention mechanism (AM) are visualized and analysed to study the interpretability, which explains the partly working pattern of the network. In the comparison test with other existing CNN, RNN, and transformer models, the diagnosis accuracy of different methods is statistically analysed, feature vectors are presented via the t-distributed stochastic neighbor embedding (t-SNE) method, and the proposed MTFST obtains the best accuracy and feature distribution form. The results demonstrate the effectiveness and superiority of the proposed method in bearing fault diagnosis.

Transformer Voiceprint Feature Extraction and Fault Recognition Based on MFCC and Deep Learning

Research on transformer fault voiceprint recognition based on Mel time-frequency spectrum-convolutional neural network

Voiceprint Fault Diagnosis of Converter Transformer under Load Influence Based on Multi-Strategy Improved Mel-Frequency Spectrum Coefficient and Temporal Convolutional Network

Optimal Transport Based Domain Adaptation Model for Transformer Voiceprint Fault Identification

Research on Transformer Voiceprint Feature Extraction Oriented to Complex Noise Environment

Research on Transformer Voiceprint Anomaly Detection Based on Data-Driven

Data-Driven Feature Extraction-Transformer: A Hybrid Fault Diagnosis Scheme Utilizing Acoustic Emission Signals

Convolutional Neural Network-Based Transformer Fault Diagnosis Using Vibration Signals

Improved Support Vector Machine for Voiceprint Diagnosis of Typical Faults in Power Transformers

Automatic Condition Monitoring and Fault Diagnosis System for Power Transformers Based on Voiceprint Recognition

Fault Voiceprint Signal Diagnosis Method of Power Transformer Based on Mixup Data Enhancement

Transformer assisted by DSC and BiLSTM for bearing fault pattern recognition under strong noise interference

CLFormer: A Lightweight Transformer Based on Convolutional Embedding and Linear Self-Attention With Strong Robustness for Bearing Fault Diagnosis Under Limited Sample Conditions

Generalized Transformer in Fault Diagnosis of Tennessee Eastman Process

Hierarchical spiking neural network auditory feature based dry-type transformer fault diagnosis using convolutional neural network

Research on Transformer Fault Diagnosis Based on Voiceprint Signal

Adaptive Diagnosis for Transformer With Unknown Faults Based on Antenna-Augmented RFID Sensor and Deep Learning

Transformer Winding Fault Diagnosis Using Vibration Image and Deep Learning

An Efficient Noise Reduction Method for Power Transformer Voiceprint Detection Based on Poly-Phase Filtering and Complex Variational Modal Decomposition

Multiscale Time-Frequency Sparse Transformer Based on Partly Interpretable Method for Bearing Fault Diagnosis

Recognition of Short-Circuit Discharge Sounds in Transmission Lines Based on Hybrid Voiceprint Features