Abstract:Data-driven remaining useful life (RUL) prediction is of vital importance to industrial equipment prognostics health management (PHM). The transformer algorithms have been applied for RUL prediction recently. RUL prediction is a typically time-correlated task. However, in most transformer-based RUL prediction methods, one of the main procedures, patch embedding, is usually implemented by linear-based or convolution-based approaches, which lacks consideration for time correlation feature extraction. Moreover, the time correlation features at different degradation states may be variable, which will make different contributions to RUL prediction. To this end, in this paper, a novel framework for RUL prediction named weighted time embedding transformer (WTE-Trans) is proposed. A WTE module is designed to enhance the capacity of the model to extract more discriminative time correlation features and impose different weights automatically. Concretely, the peak-to-peak values are calculated from input and transformed firstly to provide prior knowledge information, and then multiplied by a learnable mask to generate an adaptive weight. Afterwards, the adaptive weight is used to impose constraints on the transformed input. Secondly, multiple 3D convolution (3D-conv) modules are designed to integrate the deep features through the time axis. Finally, the shifted-window transformer block is adopted to complete the RUL prediction task. Experiments are carried out on the widely used PHM 2012 bearing dataset and an actual industrial bearing full-lifecycle dataset to verify the effectiveness and application value. The results and analysis have shown that lower prediction error can be achieved by the proposed method.

A Novel Transformer Model Based on Dynamic Convolution and ProbSparse Self-Attention for RUL Prediction of Bearings

Spatial Attention-Based Convolutional Transformer for Bearing Remaining Useful Life Prediction

Remaining useful life prognostics of bearings based on convolution attention networks and enhanced transformer

Local Enhancing Transformer With Temporal Convolutional Attention Mechanism for Bearings Remaining Useful Life Prediction

A Novel Combination Neural Network Based on ConvLSTM-Transformer for Bearing Remaining Useful Life Prediction

A Novel Prediction Method Based on Bi-Channel Hierarchical Vision Transformer for Rolling Bearings' Remaining Useful Life

Bearing Remaining Useful Life Prediction based on TCN-Transformer Model

A novel method for online prediction of the remaining useful life of rolling bearings based on wavelet power spectrogram and Transformer structure

Remaining Useful Life Prediction of Bearings Based on Convolution Attention Mechanism and Temporal Convolution Network

A Hybrid ST-Bilstm Based Prediction Method for Estimating the Life of Ball Mill Rolling Bearings

A new convolutional dual-channel Transformer network with time window concatenation for remaining useful life prediction of rolling bearings

Remaining Useful Life Prediction of Bearings Based on Self-attention Mechanism, Multi-scale Dilated Causal Convolution, and Temporal Convolution Network

Remaining Useful Life Estimation of Bearing Using Spatio-Temporal Convolutional Transformer

Compact Convolutional Transformer for Bearing Remaining Useful Life Prediction

Rolling bearing remaining useful life prediction based on dilated causal convolutional DenseNet and an exponential model

A novel Vision Transformer network for rolling bearing remaining useful life prediction

Remaining useful life prediction of rolling bearings based on time convolutional network and transformer in parallel

Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics

Direct Remaining Useful Life Prediction for Rolling Bearing Using Temporal Convolutional Networks.

Remaining useful life prediction of bearings with different failure types based on multi-feature and deep convolution transfer learning

A Weighted Time Embedding Transformer Network for Remaining Useful Life Prediction of Rolling Bearing