Abstract:Deep learning is an appropriate methodology for modeling complex industrial data in the field of soft sensors, owing to its powerful feature representation capability. Given the nonlinear and dynamic nature of the process industry, the key challenge for soft sensor technology is to effectively mine dynamic information from long sequences and accurately extract features of relevance to quality. A dual temporal attention mechanism-based convolutional long short-term memory network (DTA-ConvLSTM) under an encoder-decoder framework is proposed as a soft sensor model to acquire quality-relevant dynamic features from serial data. Considering different influences of process variables for prediction at multiple time steps and various locations, ConvLSTM and temporal self-attention mechanism are utilized as the encoder to adaptively fuse spatiotemporal features and capture long-term dynamic properties of process in order to capture the trends of industrial variables. Furthermore, a quality-driven temporal attention mechanism is employed throughout the decoding process to dynamically select relevant features to more accurately track quality changes. The encoder-decoder model meticulously analyses the interactions between process and quality variables by incorporating dual-sequence dynamic information to improve the prediction performance. The validity and superiority of the DTA-ConvLSTM model was validated on two industrial case studies of the debutanizer column and sulfur recovery unit. Compared to the traditional LSTM model, the proposed model demonstrated a substantial improvement with the accuracy R2 up to 97.3% and 94.9% and the root mean square error reducing to 0.122 and 0.022.

Two-dimensional LSTM soft sensor using noisy process data

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

Correntropy long short term memory soft sensor for quality prediction in industrial polyethylene process

Adaptive soft sensor based on time difference model and locally weighted partial least squares regression

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

LSTM Soft Sensor Development of Batch Processes with Multivariate Trajectory-Based Ensemble Just-in-Time Learning

A Supervised Bidirectional Long Short-Term Memory Network for Data-Driven Dynamic Soft Sensor Modeling.

A new regularized and robust LSTM learning algorithm for industrial soft sensors

Dual Temporal Attention Mechanism-based Convolutional LSTM Model for Industrial Dynamic Soft Sensor

Spatio‐temporal Adaptive Soft Sensor for Nonlinear Time‐varying and Variable Drifting Processes Based on Moving Window LWPLS and Time Difference Model

Deep Learning of Process Data with Supervised Variational Auto-encoder for Soft Sensor

Quality Prediction of Industrial Polyethylene Process with Robust Long Short Term Memory Model

Self-Attention Soft Sensor Model Based on Long-Short Time Span *

A Novel Semi-supervised Two-dimensional Dynamic Soft Sensor for Quality Prediction in Batch Processes

A Multi-Step Sequence-to-Sequence Model with Attention LSTM Neural Networks for Industrial Soft Sensor Application

Dynamic Features Incorporated Locally Weighted Deep Learning Model for Soft Sensor Development.

Moving Window Adaptive Soft Sensor for State Shifting Process Based on Weighted Supervised Latent Factor Analysis

Locally Weighted Kernel Principal Component Regression Model for Soft Sensing of Nonlinear Time-Variant Processes

Weighted Linear Dynamic System for Feature Representation and Soft Sensor Application in Nonlinear Dynamic Industrial Processes.

Multi-grain Cascade Recurrent Neural Network for Nonlinear Time-varying Process Soft Sensor Modeling

A Fault-Tolerant Soft Sensor Algorithm Based on Long Short-Term Memory Network for Uneven Batch Process