Abstract:Transformer model is being gradually studied and applied in bearing fault diagnosis tasks, which can overcome the feature extraction defects caused by long-term dependencies in convolution neural network (CNN) and recurrent neural network (RNN). To optimize the structure of existing transformer-like methods and improve the diagnostic accuracy, we proposed a novel method based on the multiscale time-frequency sparse transformer (MTFST) in this paper. First, a novel tokenizer based on shot-time Fourier transform (STFT) is designed, which processes the 1D format raw signals into 2D format discrete time-frequency sequences in the embedding space. Second, a sparse self-attention mechanism is designed to eliminate the feature mapping defect in naive self-attention mechanism. Then, the novel encoder-decoder structure is presented, the multiple encoders are employed to extract the hidden feature of different time-frequency sequences obtained by STFT with different window widths, and the decoder is used to remap the deep information and connect to the classifier for discriminating fault types. The proposed method is tested in the XJTU-SY bearing dataset and self-made experiment rig dataset, and the following work is conducted. The influences of hyperparameters on diagnosis accuracy and number of parameters are analysed in detail. The weights of the attention mechanism (AM) are visualized and analysed to study the interpretability, which explains the partly working pattern of the network. In the comparison test with other existing CNN, RNN, and transformer models, the diagnosis accuracy of different methods is statistically analysed, feature vectors are presented via the t-distributed stochastic neighbor embedding (t-SNE) method, and the proposed MTFST obtains the best accuracy and feature distribution form. The results demonstrate the effectiveness and superiority of the proposed method in bearing fault diagnosis.

Time-series vision transformer based on cross space-time attention for fault diagnosis in fused deposition modelling with reconstruction of layer-wise data

Deep Learning With Tensor Factorization Layers For Sequential Fault Diagnosis And Industrial Process Monitoring

Spatio-Temporal 3-D Residual Networks for Simultaneous Detection and Depth Estimation of CFRP Subsurface Defects in Lock-In Thermography

Multi-channel Fused Vision Transformer Network for Bearing Fault Diagnosis under Different Working Conditions

A Novel Hierarchical Vision Transformer and Wavelet Time–Frequency Based on Multi-Source Information Fusion for Intelligent Fault Diagnosis

STAGED: A Spatial-Temporal Aware Graph Encoder–Decoder for Fault Diagnosis in Industrial Processes

Generalized Transformer in Fault Diagnosis of Tennessee Eastman Process

A time series and deep fusion framework for rotating machinery fault diagnosis

A New Time Series Data Imaging Scheme for Mechanical Fault Diagnosis

Intelligent fault diagnosis of machinery based on hybrid deep learning with multi temporal correlation feature fusion

A novel time-frequency Transformer based on self-attention mechanism and its application in fault diagnosis of rolling bearings

Simultaneous-fault diagnosis considering time series with a deep learning transformer architecture for air handling units

A convolutional multisensor fusion fault diagnosis framework based on multidimensional distance matrix for rotating machinery

Rotating Machinery Fault Diagnosis Under Multiple Working Conditions via a Time-Series Transformer Enhanced by Convolutional Neural Network

A novel rolling bearing fault diagnosis method based on time-series fusion transformer with interpretability analysis

Bearing Fault Diagnosis Based on an Enhanced Image Representation Method of Vibration Signal and Conditional Super Token Transformer

Multiscale Time-Frequency Sparse Transformer Based on Partly Interpretable Method for Bearing Fault Diagnosis

Variational Attention-Based Interpretable Transformer Network for Rotary Machine Fault Diagnosis

Multi-feature vision transformer for automatic defect detection and quantification in composites using thermography

A novel time–frequency Transformer based on self–attention mechanism and its application in fault diagnosis of rolling bearings

DEViT: Deformable Convolution-Based Vision Transformer for Bearing Fault Diagnosis