Abstract:Nowadays, the deep learning technique has been widely applied in soft sensing benefiting from its strong ability of feature representation. However, classic dynamic soft sensing methods based on deep learning do not consider spatial-temporal and quality-relevant information simultaneously in the process data. Additionally, feature extraction methods encounter the challenge of information redundancy when dealing with large datasets. To address these challenges, we propose a novel hybrid self-attention mechanism with distributed GRUs (HSAM-dGRUs) within an encoder-decoder framework. The HSAM-dGRUs architecture contains a hybrid self-attention encoder, integrating multi-channel multi-head self-attention (MC-MSA) and quality-related self-attention (QR-SAM). The MC-MSA method effectively extracts local features through multi-channels to capture spatio-temporal characteristics in sequence data. Subsequently, the QR-SAM method introduces supervisory knowledge into the features and capture the quality-relevant information adaptively. The distributed GRUs decoder is designed to extract local dynamic hidden states from multi-channel features for accurate prediction. Two case studies on real industrial process datasets demonstrate the effectiveness and superiority of the proposed HSAM-dGRUs soft sensing approach. Note to Practitioners—In the process industry, monitoring quality variables is beneficial for tracking process status, saving energy, and reducing emissions. However, it is difficult to implement accurate measurement and real-time control for process quality in general. In this work, we propose a novel hybrid self-attention mechanism utilizing distributed gated recurrent units for soft sensing modeling of dynamic processes. The proposed method integrates an multi-channel multi-head self-attention mechanism and a quality self-attention mechanism into the encoder. The encoder is responsible for adaptively extracting spatio-temporal features and assigning weights based on quality-related information. Furthermore, a decoder based on distributed GRUs is employed to capture the dynamic information from the extracted features, enhancing the prediction task. First, the proposed methods can be trained offline based on historical dataset. Then, the well-trained model can be uploaded and use the new data for accurate online prediction. Preliminary experiments in this paper have demonstrated the feasibility of the proposed method, but it has not been tested in actual industrial production. In the future, we will work on developing a quality prediction system based on the proposed method so that it can be applied in actual industrial production.

Dynamic soft-sensing model by combining diagonal recurrent neural network with levinson predictor

Dynamic Soft-sensor Model of Diesel Oil Solidifying Point on a Crude Distillation Unit

Research and application of soft sensor of the diesel oil solidifying point based on the neural network on a crude distillation unit

DAMPNN: Dynamic Adaptive Message Passing Neural Network for Industrial Soft Sensor

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

Adaptive soft sensor based on time difference model and locally weighted partial least squares regression

Dynamic Features Incorporated Locally Weighted Deep Learning Model for Soft Sensor Development.

Data-Driven Soft Sensor Development Based on Deep Learning Technique

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

A New Soft Sensor Method for Dynamic Processes Based on Dynamic Orthogonal Forward Regression

Dynamic Soft Sensor Development Based on Convolutional Neural Networks

Development of Soft Sensor with Neural Network and Nonlinear Variable Selection for Crude Distillation Unit Process

Soft sensor modeling with dynamic interpolation neural network for multirate system

Dual Temporal Attention Mechanism-based Convolutional LSTM Model for Industrial Dynamic Soft Sensor

Data-Driven Soft Sensor Model Based on Deep Learning for Quality Prediction of Industrial Processes

DEVELOPING DYNAMIC SOFT SENSORS USING MULTIPLE NEURAL NETWORKS

Industrial Soft Sensor Prediction Based on Multi-model Integrated Method

Dynamic nonlinear soft sensor modelling method using linear slow feature analysis and least squares support vector regression for batch processes

Novel Distributed GRUs Based on Hybrid Self-Attention Mechanism for Dynamic Soft Sensing

A Novel Soft-Sensor Method Combining Dynamics and Time-Lag

Deep Learning with Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development