Abstract:Deep learning is an appropriate methodology for modeling complex industrial data in the field of soft sensors, owing to its powerful feature representation capability. Given the nonlinear and dynamic nature of the process industry, the key challenge for soft sensor technology is to effectively mine dynamic information from long sequences and accurately extract features of relevance to quality. A dual temporal attention mechanism-based convolutional long short-term memory network (DTA-ConvLSTM) under an encoder-decoder framework is proposed as a soft sensor model to acquire quality-relevant dynamic features from serial data. Considering different influences of process variables for prediction at multiple time steps and various locations, ConvLSTM and temporal self-attention mechanism are utilized as the encoder to adaptively fuse spatiotemporal features and capture long-term dynamic properties of process in order to capture the trends of industrial variables. Furthermore, a quality-driven temporal attention mechanism is employed throughout the decoding process to dynamically select relevant features to more accurately track quality changes. The encoder-decoder model meticulously analyses the interactions between process and quality variables by incorporating dual-sequence dynamic information to improve the prediction performance. The validity and superiority of the DTA-ConvLSTM model was validated on two industrial case studies of the debutanizer column and sulfur recovery unit. Compared to the traditional LSTM model, the proposed model demonstrated a substantial improvement with the accuracy R2 up to 97.3% and 94.9% and the root mean square error reducing to 0.122 and 0.022.

Quality Prediction Model for Process Sequential Data of Irregular Measurements with Sampling-Interval-attention LSTM

A SIA-LSTM Based Virtual Metrology for Quality Variables in Irregular Sampled Time Sequence of Industrial Processes

Deep learning for quality prediction of nonlinear dynamic processes with variable attention-based long short-term memory network

Deep Learning with Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development

Attention-Based Interval Aided Networks for Data Modeling of Heterogeneous Sampling Sequences with Missing Values in Process Industry

A Soft Sensor Model of Sintering Process Quality Index Based on Multi-Source Data Fusion.

A Multi-Step Sequence-to-Sequence Model with Attention LSTM Neural Networks for Industrial Soft Sensor Application

Real-time Estimation of Quality-Related Variable for Dynamic and Non-Gaussian Process Based on Semisupervised Bayesian HMM

Nonlinear Dynamic Soft Sensor Modeling with Supervised Long Short-Term Memory Network

Semi-supervised LSTM with Historical Feature Fusion Attention for Temporal Sequence Dynamic Modeling in Industrial Processes

Dual Temporal Attention Mechanism-based Convolutional LSTM Model for Industrial Dynamic Soft Sensor

Semi-Supervised Deep Dynamic Probabilistic Latent Variable Model for Multimode Process Soft Sensor Application

Novel Multimode Process Soft Sensing Methods Based on the Dynamic Mixture Variational Autoencoder Regression Model

Quality Variable Prediction for Chemical Processes Based on Semisupervised Dirichlet Process Mixture of Gaussians

Self-Attention Soft Sensor Model Based on Long-Short Time Span *

A Wide-Deep-Sequence Model-Based Quality Prediction Method in Industrial Process Analysis

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

A Supervised Bidirectional Long Short-Term Memory Network for Data-Driven Dynamic Soft Sensor Modeling.

A Spatiotemporal Industrial Soft Sensor Modeling Scheme for Quality Prediction With Missing Data

Memory-adaptive Supervised LSTM Networks for Deep Soft Sensor Development of Industrial Processes

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes