Abstract:Health indicator prediction, such as remaining useful life prediction and product quality prediction, is an important aspect of industrial intelligence. It is essential to process the massive multichannel industrial time series collected from the Industrial Internet of Things for the industrial health indicator prediction. At present, there are still three issues that need to be considered for industrial health indicator prediction. First, it is difficult to directly connect the distant positions in the industrial time series to extract the temporal relations, which decreases the efficiency of extracting the potential long-distance temporal relations and training networks. Second, it should be fully considered that data from different channels have different contributions. Equally dealing with the contributions of each channel will weaken the representational ability of prediction networks. Third, the loss function deals with early predictions and delay predictions equally, which will lead to high risks caused by delay predictions. In this article, for these issues, a novel multichannel temporal attention-based network (MCTAN) is proposed for industrial health indicator prediction, which can weigh contributions of different channels through the channel attention while avoiding the loss of the temporal information and directly connect each time series position to the local fields of the sequence through the multi-head local attention mechanism to efficiently extract potential long-distance temporal relations. Then, a weighted mean square error loss function differently dealing with early predictions and delay predictions by setting dynamic weights is presented to reduce delay predictions. Next, to deal with the above-mentioned issues systematically, a framework combining data preprocessing and MCTAN collaboratively is introduced to predict industrial health indicators through multichannel time series. Finally, the experiments are carried out on the commercial modular aero-propulsion system simulation dataset to measure the performances, including the accuracy of industrial health indicator predictions and the inference speed.

Spatio-temporal attention-based hybrid deep network for time series prediction of industrial process

Multi Time Scale Inception-Time Network for Soft Sensor of Blast Furnace Ironmaking Process

MCTAN: A Novel Multichannel Temporal Attention-Based Network for Industrial Health Indicator Prediction

Dual Cross-Attention Transformer Networks for Temporal Predictive Modeling of Industrial Process

A hybrid spatial-temporal deep learning prediction model of industrial methanol-to-olefins process

Multivariate Deep Reconstruction Neural Network for Multi-step-ahead Prediction of Industrial Process Quality Variables

Multi-Stage BiLinear Self-Attention Network for Multi-Sensor Industrial Time Series Classification

Deep Latent Variable Predictive Modeling with Online Bayesian Soft Attention Mechanism

Industrial equipment structure multivariate regression prediction via random input and hybrid temporal neural networks

TSARNet :Integrated Spatio-Temporal Attention Mechanism for Multivariate Time Series Prediction Deep Learning Framework

A Graph-Based Time-Frequency Two-Stream Network for Multistep Prediction of Key Performance Indicators in Industrial Processes

Deep Learning with Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development

An Adaptive Continual Learning Method for Nonstationary Industrial Time Series Prediction

A dual‐stage attention‐based Conv‐LSTM network for spatio‐temporal correlation and multivariate time series prediction

Multi-task spatio-temporal augmented net for industry equipment remaining useful life prediction

Parallel spatio-temporal attention-based TCN for multivariate time series prediction

Learning Temporal and Spatial Features Jointly: A Unified Framework for Space-Time Data Prediction in Industrial IoT networks

Multi-modal Hybrid Modeling Strategy Based on Gaussian Mixture Variational Autoencoder and Spatial–temporal Attention: Application to Industrial Process Prediction

Quality Prediction Modeling for Industrial Processes Using Multiscale Attention-Based Convolutional Neural Network

Dual Temporal Attention Mechanism-based Convolutional LSTM Model for Industrial Dynamic Soft Sensor

An Attention-Based Forecasting Network for Intelligent Services in Manufacturing