Abstract:Predicting Remaining Useful Life (RUL) plays a crucial role in the prognostics and health management of industrial systems that involve a variety of interrelated sensors. Given a constant stream of time series sensory data from such systems, deep learning models have risen to prominence at identifying complex, nonlinear temporal dependencies in these data. In addition to the temporal dependencies of individual sensors, spatial dependencies emerge as important correlations among these sensors, which can be naturally modelled by a temporal graph that describes time-varying spatial relationships. However, the majority of existing studies have relied on capturing discrete snapshots of this temporal graph, a coarse-grained approach that leads to loss of temporal information. Moreover, given the variety of heterogeneous sensors, it becomes vital that such inherent heterogeneity is leveraged for RUL prediction in temporal sensor graphs. To capture the nuances of the temporal and spatial relationships and heterogeneous characteristics in an interconnected graph of sensors, we introduce a novel model named Temporal and Heterogeneous Graph Neural Networks (THGNN). Specifically, THGNN aggregates historical data from neighboring nodes to accurately capture the temporal dynamics and spatial correlations within the stream of sensor data in a fine-grained manner. Moreover, the model leverages Feature-wise Linear Modulation (FiLM) to address the diversity of sensor types, significantly improving the model's capacity to learn the heterogeneity in the data sources. Finally, we have validated the effectiveness of our approach through comprehensive experiments. Our empirical findings demonstrate significant advancements on the N-CMAPSS dataset, achieving improvements of up to 19.2% and 31.6% in terms of two different evaluation metrics over state-of-the-art methods.

DVGTformer: A Dual-View Graph Transformer to Fuse Multi-Sensor Signals for Remaining Useful Life Prediction

Hidformer: Hierarchical Dual-Tower Transformer Using Multi-Scale Mergence for Long-Term Time Series Forecasting

Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction

Nonlinear Slow-varying Dynamics-assisted Temporal Graph Transformer Network for Remaining Useful Life Prediction

A new dual-channel Transformer-based Network for Remaining Useful Life Prediction

Transformer Encoder Enhanced by an Adaptive Graph Convolutional Neural Network for Prediction of Aero-Engines' Remaining Useful Life

A gated graph convolutional network with multi-sensor signals for remaining useful life prediction

Adaptive Spatio-Temporal Graph Information Fusion for Remaining Useful Life Prediction

Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics

A Dual-Scale Transformer-Based Remaining Useful Life Prediction Model in Industrial Internet of Things

Remaining Useful Life Prediction Method Based on the Spatiotemporal Graph and GCN Nested Parallel Route Model

Remaining Useful Life Prediction of Aero-Engine Based on Transformer with Tendency Retainment

Local Enhancing Transformer With Temporal Convolutional Attention Mechanism for Bearings Remaining Useful Life Prediction

Remaining Useful Life Estimation for Turbofan Engine with Transformer-based Deep Architecture.

Bayesian Gated-Transformer Model for Risk-Aware Prediction of Aero-Engine Remaining Useful Life.

Convolutional Transformer: An Enhanced Attention Mechanism Architecture for Remaining Useful Life Estimation of Bearings

A novel transformer-based DL model enhanced by position-sensitive attention and gated hierarchical LSTM for aero-engine RUL prediction

Spatial-temporal Dual-Channel Adaptive Graph Convolutional Network for Remaining Useful Life Prediction with Multi-Sensor Information Fusion

Temporal and Heterogeneous Graph Neural Network for Remaining Useful Life Prediction

A lightweight transformer and depthwise separable convolution model for remaining useful life prediction of turbofan engines

Remaining Useful Life Estimation of Bearing Using Spatio-Temporal Convolutional Transformer