Abstract:Virtual sensors have established themselves as effective tools in process industries for online estimating variables that are crucial but difficult to measure. However, multimode industrial processes render developing high-accuracy virtual sensors quite challenging. The main difficulties lie in that, in multimode processes, the distributions of process data are strongly non-Gaussian and the mathematical relationships between the explanatory and primary variables are highly nonlinear. Even within one operating mode, the primary variables could depend on the explanatory variables in nonlinear ways. In order to address these issues, this article proposes a virtual sensing approach named Bayesian nonlinear Gaussian mixture regression (BNGMR) with the aid of single-hidden layer feedforward neural networks (SLFNs). In the BNGMR, a fully Bayesian model structure that absorbs the merits of SLFNs and the mixture models is designed. In addition, we develop a training algorithm for the BNGMR to realize predictive virtual sensor development based on variational inference. Extensive assessments of the performance of the BNGMR are carried out using both artificial example and real-world industrial processes. The experiments have demonstrated the predictive advantage of the BNGMR over several benchmark methods and also have provided practitioners with good illustrations. Note to Practitioners-Although the case studies on two real-world industrial processes have verified the effectiveness and feasibility of the Bayesian nonlinear Gaussian mixture regression (BNGMR) for industrial applications, it is still worth emphasizing that before training the BNGMR, some important works on data preprocessing should be done, which include: 1) careful selection of explanatory variables that are closely related to primary variables; 2) time alignment matching between primary and explanatory variables; and 3) dealing with samples with missing values (for example, removing them) and elimination of outliers. We suggest to complete 1) and 2) based on process mechanisms and to pay particular attention to removing the outlier, as the presence of outliers could skew the estimations of Gaussian components and result in significant performance deterioration.

Variational Bayesian Learning with Reliable Likelihood Approximation for Accurate Process Quality Evaluation

A Variational Bayesian Dictionary Learning for Process Monitoring

Development of Convolutional Neural Network Based Gaussian Process Regression to Construct a Novel Probabilistic Virtual Metrology in Multi-Stage Semiconductor Processes

Industrial Data Modeling with Low-Dimensional Inputs and High-Dimensional Outputs

Dynamic Variational Bayesian Student's T Mixture Regression With Hidden Variables Propagation for Industrial Inferential Sensor Development

Bayesian Nonlinear Gaussian Mixture Regression and Its Application to Virtual Sensing for Multimode Industrial Processes.

Amortized Variational Inference for Deep Gaussian Processes

A Novel Scalable Semi-supervised GMM and Its Application for Multimode Process Quality Prediction with Big Data

Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling

Scalable Semisupervised GMM for Big Data Quality Prediction in Multimode Processes.

Variational Inference over Graph: Knowledge Representation for Deep Process Data Analytics

Improving Data-Driven Inferential Sensor Modeling by Industrial Knowledge: A Bayesian Perspective

Variational Inference for Uncertainty on the Inputs of Gaussian Process Models

Deep Gaussian Processes with Importance-Weighted Variational Inference

Variational Bayesian Gaussian Mixture Regression for Soft Sensing Key Variables in Non-Gaussian Industrial Processes.

Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inference

Deep Probabilistic Graphical Modeling

Beyond the Mean-Field: Structured Deep Gaussian Processes Improve the Predictive Uncertainties

Learning Deep Generative Models with Doubly Stochastic Gradient MCMC

Learning inducing points and uncertainty on molecular data by scalable variational Gaussian processes

Bayesian Meta-Learning Through Variational Gaussian Processes