Abstract:In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for training, transformers. Transformer models excel at capturing contextual features in sequential data since time series data are sequential, transformer models can be leveraged for more efficient time series data prediction. The field of prognostics is vital to system health management and proper maintenance planning. A reliable estimation of the remaining useful life (RUL) of machines holds the potential for substantial cost savings. This includes avoiding abrupt machine failures, maximizing equipment usage, and serving as a decision support system (DSS). This work proposed an encoder-transformer architecture-based framework for multivariate time series prediction for a prognostics use case. We validated the effectiveness of the proposed framework on all four sets of the C-MAPPS benchmark dataset for the remaining useful life prediction task. To effectively transfer the knowledge and application of transformers from the natural language domain to time series, three model-specific experiments were conducted. Also, to enable the model awareness of the initial stages of the machine life and its degradation path, a novel expanding window method was proposed for the first time in this work, it was compared with the sliding window method, and it led to a large improvement in the performance of the encoder transformer model. Finally, the performance of the proposed encoder-transformer model was evaluated on the test dataset and compared with the results from 13 other state-of-the-art (SOTA) models in the literature and it outperformed them all with an average performance increase of 137.65% over the next best model across all the datasets.

A Lifetime Prediction Approach Based on Adversarial Variational Auto-Encoder Networks for Dry-Type Power Transformers

Self-Adjusting Domain Adversarial Transfer Learning Algorithm for Power Transformer Lifetime Prediction

An Approach Based on Transfer Learning to Lifetime Degradation Rate Prediction of the Dry-Type Transformer

A Deep Learning Approach to the Transformer Life Prediction Considering Diverse Aging Factors

Economic Life Prediction of Power Transformers Based on the Lifetime Data

A hybrid ensemble learning approach for the aging-dependent reliability prediction of power transformers

Prediction of remaining life of power transformers based on left truncated and right censored lifetime data

Remaining useful life prediction techniques for electric valves based on convolution auto encoder and long short term memory

Research on economic remaining life of power transformers based on the lifetime data

Residual Lifetime Evaluation of Power Transformers Based on Data Fusion and Wiener Model

Power Transformer Operating State Prediction Method Based on an LSTM Network

Remaining Useful Life Prediction of Aero-Engine Based on Transformer with Tendency Retainment

A new dual-channel Transformer-based Network for Remaining Useful Life Prediction

A New Method for Transformer Fault Prediction Based on Multifeature Enhancement and Refined Long Short-Term Memory

A Transformer-based Framework For Multi-variate Time Series: A Remaining Useful Life Prediction Use Case

A Prediction Method for Power Transformer State Parameters Based on Grid Long Short-Term Memory Network

A Comparative Study of Machine Learning-Based Time Series Prediction of Electricity Consumption in Virtual Power Plants

Enhancing lithium-ion battery lifespan early prediction using a multi-branch vision transformer model

The residual life prediction of power grid transformers based on GA-ELM computational model and digital twin data

Prediction Method for Power Transformer Running State Based on LSTM_DBN Network

Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction