Abstract:Virtual sensors have established themselves as effective tools in process industries for online estimating variables that are crucial but difficult to measure. However, multimode industrial processes render developing high-accuracy virtual sensors quite challenging. The main difficulties lie in that, in multimode processes, the distributions of process data are strongly non-Gaussian and the mathematical relationships between the explanatory and primary variables are highly nonlinear. Even within one operating mode, the primary variables could depend on the explanatory variables in nonlinear ways. In order to address these issues, this article proposes a virtual sensing approach named Bayesian nonlinear Gaussian mixture regression (BNGMR) with the aid of single-hidden layer feedforward neural networks (SLFNs). In the BNGMR, a fully Bayesian model structure that absorbs the merits of SLFNs and the mixture models is designed. In addition, we develop a training algorithm for the BNGMR to realize predictive virtual sensor development based on variational inference. Extensive assessments of the performance of the BNGMR are carried out using both artificial example and real-world industrial processes. The experiments have demonstrated the predictive advantage of the BNGMR over several benchmark methods and also have provided practitioners with good illustrations. Note to Practitioners-Although the case studies on two real-world industrial processes have verified the effectiveness and feasibility of the Bayesian nonlinear Gaussian mixture regression (BNGMR) for industrial applications, it is still worth emphasizing that before training the BNGMR, some important works on data preprocessing should be done, which include: 1) careful selection of explanatory variables that are closely related to primary variables; 2) time alignment matching between primary and explanatory variables; and 3) dealing with samples with missing values (for example, removing them) and elimination of outliers. We suggest to complete 1) and 2) based on process mechanisms and to pay particular attention to removing the outlier, as the presence of outliers could skew the estimations of Gaussian components and result in significant performance deterioration.

Deep Latent Variable Predictive Modeling with Online Bayesian Soft Attention Mechanism

Long-short Memory with Feature Representation by Latent-variable Model for Industrial Soft Sensor

Deep Learning of Latent Variable Models for Industrial Process Monitoring

A Model Combining Seq2Seq Network and LightGBM Algorithm for Industrial Soft Sensor

Dynamic Probabilistic Latent Variable Model for Process Data Modeling and Regression Application

Monitoring and prediction of big process data with deep latent variable models and parallel computing

Weighted Nonlinear Dynamic System for Deep Extraction of Nonlinear Dynamic Latent Variables and Industrial Application

Nonlinear Probabilistic Latent Variable Regression Models for Soft Sensor Application: from Shallow to Deep Structure

Latent Variable Models in the Era of Industrial Big Data: Extension and Beyond

Adaptive Attention-Driven Manifold Regularization for Deep Learning Networks: Industrial Predictive Modeling Applications and Beyond

Semi-Supervised Deep Dynamic Probabilistic Latent Variable Model for Multimode Process Soft Sensor Application

Bayesian Just-in-Time Learning and Its Application to Industrial Soft Sensing.

Dual Temporal Attention Mechanism-based Convolutional LSTM Model for Industrial Dynamic Soft Sensor

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

Adaptive Soft Sensors for Quality Prediction under the Framework of Bayesian Network

Deep Learning for Industrial KPI Prediction: when Ensemble Learning Meets Semi-Supervised Data

Bayesian Nonlinear Gaussian Mixture Regression and Its Application to Virtual Sensing for Multimode Industrial Processes.

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

A Novel Streaming Variational Bayesian Supervised Factor Analysis For Industrial Adaptive Soft Sensor Modeling

Semi-supervised Mixture of Latent Factor Analysis Models with Application to Online Key Variable Estimation

Dynamic Features Incorporated Locally Weighted Deep Learning Model for Soft Sensor Development.