Abstract:In practical engineering, accurate prediction of remaining useful life (RUL) is always necessary for effective preparation of engineering assets, human resources and maintenance actions. With the improvement of computing power and the passionate requirements for the high prediction accuracy of complex systems, more and more deep model-based frameworks have been developed for RUL prediction. In general, these frameworks consist of two stages: the first one is the manual operation of feature extraction and feature selection; the second one is the RUL prediction that mainly employs the recurrent deep models. However, such the frameworks do not fully take advantage of the deep models since they still rely on much prior knowledge and do not achieve the satisfied prediction performance. In this paper, a novel two stage framework with less prior knowledge, namely, end-to-end framework, is proposed to improve the forecasting performance. In our first stage, a feature preextraction mechanism is designed to pre-extract the low-level features in relatively high dimensional space, which requires no additional manual operations of feature fusion and feature selection in existing methods. In our second stage, adaptive transformer, a new deep model integrating the attention mechanism and the recurrent architecture, is proposed to model the relationships between these low-level features and the RULs directly, which suppresses the issue of vanishing gradients and is more suitable for representing the complex temporal degradation characteristics. Two public bearing datasets are employed to validate the effectiveness of the proposed framework in this paper. In these two case studies, some existing state-of-the-art RUL prediction approaches are fully compared, and the critical hyperparameters and components of our framework are analyzed in details. The experimental results reveal our advantage on adaptive degradation modeling and accurate RUL prediction, and help to interpret the impact of the proposed framework architecture on bearing RUL prediction.

Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics

Local Enhancing Transformer With Temporal Convolutional Attention Mechanism for Bearings Remaining Useful Life Prediction

End-to-end Temporal Transformer with Autocorrelated Attention Mechanism Augmented for Remaining Useful Life Prediction of Turbopump Bearings

A Weighted Time Embedding Transformer Network for Remaining Useful Life Prediction of Rolling Bearing

Convolutional Transformer: An Enhanced Attention Mechanism Architecture for Remaining Useful Life Estimation of Bearings

Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction

Remaining Useful Life Estimation of Bearing Using Spatio-Temporal Convolutional Transformer

Spatial Attention-Based Convolutional Transformer for Bearing Remaining Useful Life Prediction

A Novel Transformer Model Based on Dynamic Convolution and ProbSparse Self-Attention for RUL Prediction of Bearings

An End-to-end Framework for Remaining Useful Life Prediction of Rolling Bearing Based on Feature Pre-Extraction Mechanism and Deep Adaptive Transformer Model.

Compact Convolutional Transformer for Bearing Remaining Useful Life Prediction

A Novel Combination Neural Network Based on ConvLSTM-Transformer for Bearing Remaining Useful Life Prediction

A new convolutional dual-channel Transformer network with time window concatenation for remaining useful life prediction of rolling bearings

Remaining useful life prediction of rolling bearings based on time convolutional network and transformer in parallel

Remaining useful life prognostics of bearings based on convolution attention networks and enhanced transformer

Knowledge enhanced ensemble method for remaining useful life prediction under variable working conditions

Machinery Prognostics and High-Dimensional Data Feature Extraction Based on a Transformer Self-Attention Transfer Network

Remaining Useful Life Prediction of Bearings Based on Convolution Attention Mechanism and Temporal Convolution Network

A bearing remaining life prediction method under variable operating conditions based on Cross-Transformer fusioning segmented data cleaning

A new dual-channel Transformer-based Network for Remaining Useful Life Prediction

Remaining Useful Life Prediction of Aero-Engine Based on Transformer with Tendency Retainment