Abstract:Deep learning is an appropriate methodology for modeling complex industrial data in the field of soft sensors, owing to its powerful feature representation capability. Given the nonlinear and dynamic nature of the process industry, the key challenge for soft sensor technology is to effectively mine dynamic information from long sequences and accurately extract features of relevance to quality. A dual temporal attention mechanism-based convolutional long short-term memory network (DTA-ConvLSTM) under an encoder-decoder framework is proposed as a soft sensor model to acquire quality-relevant dynamic features from serial data. Considering different influences of process variables for prediction at multiple time steps and various locations, ConvLSTM and temporal self-attention mechanism are utilized as the encoder to adaptively fuse spatiotemporal features and capture long-term dynamic properties of process in order to capture the trends of industrial variables. Furthermore, a quality-driven temporal attention mechanism is employed throughout the decoding process to dynamically select relevant features to more accurately track quality changes. The encoder-decoder model meticulously analyses the interactions between process and quality variables by incorporating dual-sequence dynamic information to improve the prediction performance. The validity and superiority of the DTA-ConvLSTM model was validated on two industrial case studies of the debutanizer column and sulfur recovery unit. Compared to the traditional LSTM model, the proposed model demonstrated a substantial improvement with the accuracy R2 up to 97.3% and 94.9% and the root mean square error reducing to 0.122 and 0.022.

A Data-Driven Self-Supervised LSTM-DeepFM Model for Industrial Soft Sensor

A Model Combining Seq2Seq Network and LightGBM Algorithm for Industrial Soft Sensor

Long-short Memory with Feature Representation by Latent-variable Model for Industrial Soft Sensor

Dual Temporal Attention Mechanism-based Convolutional LSTM Model for Industrial Dynamic Soft Sensor

Deep Learning of Semisupervised Process Data with Hierarchical Extreme Learning Machine and Soft Sensor Application

A New Deep Learning Model for Semi-supervised Soft-sensing of an Industrial Production Process

Dynamic Features Incorporated Locally Weighted Deep Learning Model for Soft Sensor Development.

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

Deep Learning with Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development

A Multi-Step Sequence-to-Sequence Model with Attention LSTM Neural Networks for Industrial Soft Sensor Application

A Deep Supervised Learning Framework for Data-Driven Soft Sensor Modeling of Industrial Processes

Semi-supervised LSTM with Historical Feature Fusion Attention for Temporal Sequence Dynamic Modeling in Industrial Processes

Weighted Nonlinear Dynamic System for Deep Extraction of Nonlinear Dynamic Latent Variables and Industrial Application

Deep Learning for Industrial KPI Prediction: when Ensemble Learning Meets Semi-Supervised Data

Semi-supervised Deep Conditional Variational Auto-encoder for Soft Sensor Modeling

Self-Attention Soft Sensor Model Based on Long-Short Time Span *

Semi-Supervised Deep Dynamic Probabilistic Latent Variable Model for Multimode Process Soft Sensor Application

A new regularized and robust LSTM learning algorithm for industrial soft sensors

A Soft Sensor Modeling Framework Embedded with Domain Knowledge Based on Spatio-Temporal Deep LSTM for Process Industry

Research on Modeling of Industrial Soft Sensor Based on Ensemble Learning

Laplacian Regularization of Linear Regression Model for Semi-Supervised Industrial Soft Sensor Development