Abstract:Nowadays, the deep learning technique has been widely applied in soft sensing benefiting from its strong ability of feature representation. However, classic dynamic soft sensing methods based on deep learning do not consider spatial-temporal and quality-relevant information simultaneously in the process data. Additionally, feature extraction methods encounter the challenge of information redundancy when dealing with large datasets. To address these challenges, we propose a novel hybrid self-attention mechanism with distributed GRUs (HSAM-dGRUs) within an encoder-decoder framework. The HSAM-dGRUs architecture contains a hybrid self-attention encoder, integrating multi-channel multi-head self-attention (MC-MSA) and quality-related self-attention (QR-SAM). The MC-MSA method effectively extracts local features through multi-channels to capture spatio-temporal characteristics in sequence data. Subsequently, the QR-SAM method introduces supervisory knowledge into the features and capture the quality-relevant information adaptively. The distributed GRUs decoder is designed to extract local dynamic hidden states from multi-channel features for accurate prediction. Two case studies on real industrial process datasets demonstrate the effectiveness and superiority of the proposed HSAM-dGRUs soft sensing approach. Note to Practitioners—In the process industry, monitoring quality variables is beneficial for tracking process status, saving energy, and reducing emissions. However, it is difficult to implement accurate measurement and real-time control for process quality in general. In this work, we propose a novel hybrid self-attention mechanism utilizing distributed gated recurrent units for soft sensing modeling of dynamic processes. The proposed method integrates an multi-channel multi-head self-attention mechanism and a quality self-attention mechanism into the encoder. The encoder is responsible for adaptively extracting spatio-temporal features and assigning weights based on quality-related information. Furthermore, a decoder based on distributed GRUs is employed to capture the dynamic information from the extracted features, enhancing the prediction task. First, the proposed methods can be trained offline based on historical dataset. Then, the well-trained model can be uploaded and use the new data for accurate online prediction. Preliminary experiments in this paper have demonstrated the feasibility of the proposed method, but it has not been tested in actual industrial production. In the future, we will work on developing a quality prediction system based on the proposed method so that it can be applied in actual industrial production.

Quality Prediction Modeling for Industrial Processes Using Multiscale Attention-Based Convolutional Neural Network

Augmented Multidimensional Convolutional Neural Network for Industrial Soft Sensing

Convolutional Neural Networks for Multi-Stage Semiconductor Processes

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

Soft Sensor Model for Dynamic Processes Based on Multichannel Convolutional Neural Network

Novel Multi-flow Multi-scale Convolutional Neural Network Developed for Quality Prediction of Batch Processes to Fuse Data With Different Sampling Frequencies

Frame-Dilated Convolutional Fusion Network and GRU-Based Self-Attention Dual-Channel Network for Soft-Sensor Modeling of Industrial Process Quality Indexes

Deep learning for quality prediction of nonlinear dynamic processes with variable attention-based long short-term memory network

A Soft Sensor for Multirate Quality Variables Based on MC-CNN

Nonlinear Dynamic Soft Sensor Development with a Supervised Hybrid CNN-LSTM Network for Industrial Processes.

Multivariate Deep Reconstruction Neural Network for Multi-step-ahead Prediction of Industrial Process Quality Variables

A Multi-Step Sequence-to-Sequence Model with Attention LSTM Neural Networks for Industrial Soft Sensor Application

Multiscale Dynamic Feature Learning for Quality Prediction Based on Hierarchical Sequential Generative Network

Dynamic Soft Sensor Development Based on Convolutional Neural Networks

Self-adaptive Graph Convolution Networks with Application to Industrial Soft Sensor Modeling

Novel Distributed GRUs Based on Hybrid Self-Attention Mechanism for Dynamic Soft Sensing

Batch process soft sensing based on data-stacking multiscale adaptive graph neural network

Dual Temporal Attention Mechanism-based Convolutional LSTM Model for Industrial Dynamic Soft Sensor

Deep Learning with Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development

A modeling method of wide random forest multi-output soft sensor with attention mechanism for quality prediction of complex industrial processes

A Cloud-Edge Collaborative Framework for Adaptive Quality Prediction Modeling in IIoT