Abstract:Nowadays, the deep learning technique has been widely applied in soft sensing benefiting from its strong ability of feature representation. However, classic dynamic soft sensing methods based on deep learning do not consider spatial-temporal and quality-relevant information simultaneously in the process data. Additionally, feature extraction methods encounter the challenge of information redundancy when dealing with large datasets. To address these challenges, we propose a novel hybrid self-attention mechanism with distributed GRUs (HSAM-dGRUs) within an encoder-decoder framework. The HSAM-dGRUs architecture contains a hybrid self-attention encoder, integrating multi-channel multi-head self-attention (MC-MSA) and quality-related self-attention (QR-SAM). The MC-MSA method effectively extracts local features through multi-channels to capture spatio-temporal characteristics in sequence data. Subsequently, the QR-SAM method introduces supervisory knowledge into the features and capture the quality-relevant information adaptively. The distributed GRUs decoder is designed to extract local dynamic hidden states from multi-channel features for accurate prediction. Two case studies on real industrial process datasets demonstrate the effectiveness and superiority of the proposed HSAM-dGRUs soft sensing approach. Note to Practitioners—In the process industry, monitoring quality variables is beneficial for tracking process status, saving energy, and reducing emissions. However, it is difficult to implement accurate measurement and real-time control for process quality in general. In this work, we propose a novel hybrid self-attention mechanism utilizing distributed gated recurrent units for soft sensing modeling of dynamic processes. The proposed method integrates an multi-channel multi-head self-attention mechanism and a quality self-attention mechanism into the encoder. The encoder is responsible for adaptively extracting spatio-temporal features and assigning weights based on quality-related information. Furthermore, a decoder based on distributed GRUs is employed to capture the dynamic information from the extracted features, enhancing the prediction task. First, the proposed methods can be trained offline based on historical dataset. Then, the well-trained model can be uploaded and use the new data for accurate online prediction. Preliminary experiments in this paper have demonstrated the feasibility of the proposed method, but it has not been tested in actual industrial production. In the future, we will work on developing a quality prediction system based on the proposed method so that it can be applied in actual industrial production.

Soft sensor based on eXtreme gradient boosting and bidirectional converted gates long short-term memory self-attention network

A Model Combining Seq2Seq Network and LightGBM Algorithm for Industrial Soft Sensor

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

Self-Attention Soft Sensor Model Based on Long-Short Time Span *

Development of a Novel Soft Sensor with Long Short-Term Memory Network and Normalized Mutual Information Feature Selection

A Self-Interpretable Soft Sensor Based On Deep Learning and Multiple Attention Mechanism: From Data Selection to Sensor Modeling

Improved Bi-LSTM With Distributed Nonlinear Extensions and Parallel Inputs for Soft Sensing

A Multi-Step Sequence-to-Sequence Model with Attention LSTM Neural Networks for Industrial Soft Sensor Application

A Variable Selection Method for Soft Sensor Development Through Mixed Integer Quadratic Programming

Dual Temporal Attention Mechanism-based Convolutional LSTM Model for Industrial Dynamic Soft Sensor

Multi-grain Cascade Recurrent Neural Network for Nonlinear Time-varying Process Soft Sensor Modeling

Soft Sensor for Melting Flow Rate Prediction based on Data-enhanced Classification Method

Dynamic Features Incorporated Locally Weighted Deep Learning Model for Soft Sensor Development.

Soft Sensor Development for Multimode Processes Based on Semisupervised Gaussian Mixture Models

Deep Semi-Supervised Just-in-Time Learning Based Soft Sensor for Mooney Viscosity Estimation in Industrial Rubber Mixing Process

Soft Sensor Development And Applications Based On Lstm In Deep Neural Networks

ConvLSTM and Self-Attention Aided Canonical Correlation Analysis for Multioutput Soft Sensor Modeling

Novel Distributed GRUs Based on Hybrid Self-Attention Mechanism for Dynamic Soft Sensing

Batch process soft sensing based on data-stacking multiscale adaptive graph neural network

DA-CBGRU-Seq2Seq based soft sensor for mechanical properties of hot rolling process