Abstract:Virtual sensors have established themselves as effective tools in process industries for online estimating variables that are crucial but difficult to measure. However, multimode industrial processes render developing high-accuracy virtual sensors quite challenging. The main difficulties lie in that, in multimode processes, the distributions of process data are strongly non-Gaussian and the mathematical relationships between the explanatory and primary variables are highly nonlinear. Even within one operating mode, the primary variables could depend on the explanatory variables in nonlinear ways. In order to address these issues, this article proposes a virtual sensing approach named Bayesian nonlinear Gaussian mixture regression (BNGMR) with the aid of single-hidden layer feedforward neural networks (SLFNs). In the BNGMR, a fully Bayesian model structure that absorbs the merits of SLFNs and the mixture models is designed. In addition, we develop a training algorithm for the BNGMR to realize predictive virtual sensor development based on variational inference. Extensive assessments of the performance of the BNGMR are carried out using both artificial example and real-world industrial processes. The experiments have demonstrated the predictive advantage of the BNGMR over several benchmark methods and also have provided practitioners with good illustrations. Note to Practitioners-Although the case studies on two real-world industrial processes have verified the effectiveness and feasibility of the Bayesian nonlinear Gaussian mixture regression (BNGMR) for industrial applications, it is still worth emphasizing that before training the BNGMR, some important works on data preprocessing should be done, which include: 1) careful selection of explanatory variables that are closely related to primary variables; 2) time alignment matching between primary and explanatory variables; and 3) dealing with samples with missing values (for example, removing them) and elimination of outliers. We suggest to complete 1) and 2) based on process mechanisms and to pay particular attention to removing the outlier, as the presence of outliers could skew the estimations of Gaussian components and result in significant performance deterioration.

Parameter Estimation of Gaussian Mixture Model Based on Variational Bayesian Learning

Variational Bayesian Learning for Parameter Estimation of Mixture of Gaussians

Variational Learning for Finite Beta-Liouville Mixture Models and Its Application

Parameter Estimation for Gaussian Mixture Processes Based on Expectation-Maximization Method

Adaptive Parameter Estimation of GMM and Its Application in Clustering

Bayesian Estimation of Beta Mixture Models with Variational Inference

MAP approximation to the variational Bayes Gaussian mixture model and application

Variational Bayesian Gaussian Mixture Regression for Soft Sensing Key Variables in Non-Gaussian Industrial Processes.

Hybrid GA Variational Bayes inference of finite mixture models for voxel classification in brain images

Bayesian Estimation of the Von-Mises Fisher Mixture Model with Variational Inference

Steady-state and Transient Operation Discrimination by Variational Bayesian Gaussian Mixture Models

State Estimation in Unknown Non-Gaussian Measurement Noise Using Variational Bayesian Technique.

On Parameter Estimation in Deviated Gaussian Mixture of Experts

Efficient Variational Bayesian Model Updating by Bayesian Active Learning

Parameter Expanded Variational Bayesian Methods

Bayesian Nonlinear Gaussian Mixture Regression and Its Application to Virtual Sensing for Multimode Industrial Processes.

A Unified Perspective on Natural Gradient Variational Inference with Gaussian Mixture Models

Adaptive Learning Algorithm Based on Mixture Gaussian Background

Variational Learning for Finite Inverted Dirichlet Mixture Models and Applications

Extended Variational Inference for Gamma Mixture Model in Positive Vectors Modeling

Learning Gaussian Mixture with Automatic Model Selection: A Comparative Study on Three Bayesian Related Approaches