Abstract:The Gaussian process is a powerful statistical learning model and has been applied widely in nonlinear regression and classification. However, it fails to model multi-modal data from a non-stationary source since a prior Gaussian process is generally stationary. Based on the idea of the mixture of experts, the mixture of Gaussian processes was established to increase the model flexibility. On the other hand, the Gaussian process is also sensitive to outliers and thus robust Gaussian processes have been suggested to own the heavy-tailed property. In practical applications, the datasets may be multi-modal and contain outliers at the same time. In order to overcome these two difficulties together, we propose a mixture of robust Gaussian processes (MRGP) model and establish a precise hard-cut EM algorithm for learning its parameters. Since the exact solving process is intractable due to the fact that non-Gaussian probability density functions of the noises are adopted into the likelihood of the proposed model on the dataset, we employ a variational bounding method to approximate the marginal likelihood functions so that the hard-cut EM algorithm can be implemented effectively. Moreover, we conduct various experiments on both synthetic and real-world datasets to evaluate and compare our proposed MRGP method with several competitive nonlinear regression methods. The experimental results demonstrate that our MRGP model with the hard-cut EM algorithm is much more effective and robust than the competitive nonlinear regression models. (c) 2021 Elsevier B.V. All rights reserved.

A Daem Algorithm For Mixtures Of Gaussian Process Functional Regressions

An Efficient EM Algorithm for Two-Layer Mixture Model of Gaussian Process Functional Regressions

A Two-Layer Mixture Model of Gaussian Process Functional Regressions and Its MCMC EM Algorithm

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

On Semi-Supervised Learning Genetic-Based And Deterministic Annealing Em Algorithm For Dirichlet Mixture Models

On Convergence and Parameter Selection of the EM and DA-EM Algorithms for Gaussian Mixtures

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes

Mixture of robust Gaussian processes and its hard-cut EM algorithm with variational bounding approximation

A <formula Formulatype="inline"><tex>$q$</tex></formula>-Parameterized Deterministic Annealing EM Algorithm Based on Nonextensive Statistical Mechanics

A Parameter Selection Method of the Deterministic Anti-Annealing Algorithm for Network Exploring

A Variational Hardcut EM Algorithm for the Mixtures of Gaussian Processes

An Improved Mixture Model of Gaussian Processes and Its Classification Expectation–Maximization Algorithm

A Precise Hard-Cut EM Algorithm for Mixtures of Gaussian Processes.

High Dimension Finite Mixture Gaussian Model Estimation For Short Time Fourier Decomposition By Em-Algorithm

Random Swap Em Algorithm for Gaussian Mixture Models

The Competitive EM Algorithm for Gaussian Mixtures with BYY Harmony Criterion

Automated Model Selection of the Two-Layer Mixtures of Gaussian Process Functional Regressions for Curve Clustering and Prediction

Network EM Algorithm for Gaussian Mixture Model in Decentralized Federated Learning

The Hard-Cut EM Algorithm for Mixture of Sparse Gaussian Processes

An Exact Line Search Scheme to Accelerate the EM Algorithm: Application to Gaussian Mixture Models Identification