Abstract:Machinery degradation assessment can offer meaningful prognosis and health management information. Although numerous machine prediction models based on artificial intelligence have emerged in recent years, they still face a series of challenges: (1) Many models continue to rely on manual feature extraction. (2) Deep learning models still struggle with long sequence prediction tasks. (3) Health indicators are inefficient for remaining useful life (RUL) prediction with cross-operational environments when dealing with high-dimensional datasets as inputs. This research proposes a health indicator construction methodology based on a transformer self-attention transfer network (TSTN). This methodology can directly deal with the high-dimensional raw dataset and keep all the information without missing when the signals are taken as the input of the diagnosis and prognosis model. First, we design an encoder with a long-term and short-term self-attention mechanism to capture crucial time-varying information from a high-dimensional dataset. Second, we propose an estimator that can map the embedding from the encoder output to the estimated degradation trends. Then, we present a domain discriminator to extract invariant features from different machine operating conditions. Case studies were carried out using the FEMTO-ST bearing dataset, and the Monte Carlo method was employed for RUL prediction during the degradation process. When compared to other established techniques such as the RNN-based RUL prediction method, convolutional LSTM network, Bi-directional LSTM network with attention mechanism, and the traditional RUL prediction method based on vibration frequency anomaly detection and survival time ratio, our proposed TSTN method demonstrates superior RUL prediction accuracy with a notable SCORE of 0.4017. These results underscore the significant advantages and potential of the TSTN approach over other state-of-the-art techniques.

Infrared image stream based regressors for contactless machine prognostics

Spatiotemporal denoising wavelet network for infrared thermography-based machine prognostics integrating ensemble uncertainty

A Multiscale Sparse Ensemble Network for Machine Prognostics Based on Infrared Image Streams

A Spatiotemporal Dynamic Wavelet Network for Infrared Thermography-Based Machine Prognostics

A Remaining Useful Life Prediction Framework Integrating Multiple Time Window Convolutional Neural Networks

An Improved Method for Predicting the Remaining Useful Life Using a Spatial–Temporal Feature Extraction Network With Attention Mechanism

A dual-stream temporal convolutional network for remaining useful life prediction of rolling bearings

Sparse Hierarchical Parallel Residual Networks Ensemble for Infrared Image Stream-Based Remaining Useful Life Prediction

Deep Separable Convolutional Network for Remaining Useful Life Prediction of Machinery

Deep Spatiotemporal Convolutional-Neural-Network-Based Remaining Useful Life Estimation of Bearings

Recurrent Convolutional Neural Network: A New Framework for Remaining Useful Life Prediction of Machinery.

Remaining Useful Life Prognostics of Bearings Based on a Novel Spatial Graph-Temporal Convolution Network

Spatiotemporal Non-Negative Projected Convolutional Network with Bidirectional NMF and 3DCNN for Remaining Useful Life Estimation of Bearings.

A piecewise method for bearing remaining useful life estimation using temporal convolutional networks

A recurrent neural network approach for remaining useful life prediction utilizing a novel trend features construction method

Machinery Prognostics and High-Dimensional Data Feature Extraction Based on a Transformer Self-Attention Transfer Network

Remaining Useful Life Prediction Using Temporal Deep Degradation Network for Complex Machinery with Attention-based Feature Extraction

Residual Convolution LSTM Network for Machines Remaining Useful Life Prediction and Uncertainty Quantification

Remaining Useful Life Prediction of Bearings Based on Convolution Attention Mechanism and Temporal Convolution Network

Remaining Useful Life Prediction Based on Adaptive SHRINKAGE Processing and Temporal Convolutional Network

Remaining Useful Life Prediction of Mechanical Equipment based on Time-series Auto-Correlation Decomposition and CNN