Abstract:Data-driven remaining useful life (RUL) prediction is of vital importance to industrial equipment prognostics health management (PHM). The transformer algorithms have been applied for RUL prediction recently. RUL prediction is a typically time-correlated task. However, in most transformer-based RUL prediction methods, one of the main procedures, patch embedding, is usually implemented by linear-based or convolution-based approaches, which lacks consideration for time correlation feature extraction. Moreover, the time correlation features at different degradation states may be variable, which will make different contributions to RUL prediction. To this end, in this paper, a novel framework for RUL prediction named weighted time embedding transformer (WTE-Trans) is proposed. A WTE module is designed to enhance the capacity of the model to extract more discriminative time correlation features and impose different weights automatically. Concretely, the peak-to-peak values are calculated from input and transformed firstly to provide prior knowledge information, and then multiplied by a learnable mask to generate an adaptive weight. Afterwards, the adaptive weight is used to impose constraints on the transformed input. Secondly, multiple 3D convolution (3D-conv) modules are designed to integrate the deep features through the time axis. Finally, the shifted-window transformer block is adopted to complete the RUL prediction task. Experiments are carried out on the widely used PHM 2012 bearing dataset and an actual industrial bearing full-lifecycle dataset to verify the effectiveness and application value. The results and analysis have shown that lower prediction error can be achieved by the proposed method.

A Study of a Domain-Adaptive LSTM-DNN-Based Method for Remaining Useful Life Prediction of Planetary Gearbox

Remaining Useful Life Prediction of Gearbox under Variable Operating Conditions based on KPCA and LSTM

Long-term gear life prediction based on ordered neurons LSTM neural networks

A Novel Combination Neural Network Based on ConvLSTM-Transformer for Bearing Remaining Useful Life Prediction

A novel machinery RUL prediction method based on exponential model and cross-domain health indicator considering first-to-end prediction time

Deep transfer learning based on dynamic domain adaptation for remaining useful life prediction under different working conditions

Digital Twin-Driven Remaining Useful Life Prediction for Gear Performance Degradation: A Review

Remaining Useful Life Prediction of Rolling Element Bearings Based on Hybrid Drive of Data and Model

Remaining useful life prediction of planet bearings based on conditional deep recurrent generative adversarial network and action discovery

Deep transfer learning-based hierarchical adaptive remaining useful life prediction of bearings considering the correlation of multistage degradation

Prediction of the Remaining Useful Life of Bearings Through CNN-Bi-LSTM-Based Domain Adaptation Model

Long Short-Term Memory Neural Network with Transfer Learning and Ensemble Learning for Remaining Useful Life Prediction

Deep transfer learning based on Bi-LSTM and attention for remaining useful life prediction of rolling bearing

A Weighted Time Embedding Transformer Network for Remaining Useful Life Prediction of Rolling Bearing

Remaining Life Prediction Method for Rolling Bearing Based on the Long Short-Term Memory Network

Fault Knowledge Transfer Assisted Ensemble Method for Remaining Useful Life Prediction

Digital Twin-Driven Graph Domain Adaptation Neural Network for Remaining Useful Life Prediction of Rolling Bearing

Method for Predicting RUL of Rolling Bearings under Different Operating Conditions Based on Transfer Learning and Few Labeled Data

Research on Digital Twin Driven Rolling Bearing Model-Data Fusion Life Prediction Method

Life prediction of jet engines based on LSTM-recurrent neural networks

Knowledge enhanced ensemble method for remaining useful life prediction under variable working conditions