Abstract:Regression mixture models are widely studied in statistics, machine learning and data analysis. Fitting regression mixtures is challenging and is usually performed by maximum likelihood by using the expectation-maximization (EM) algorithm. However, it is well-known that the initialization is crucial for EM. If the initialization is inappropriately performed, the EM algorithm may lead to unsatisfactory results. The EM algorithm also requires the number of clusters to be given a priori; the problem of selecting the number of mixture components requires using model selection criteria to choose one from a set of pre-estimated candidate models. We propose a new fully unsupervised algorithm to learn regression mixture models with unknown number of components. The developed unsupervised learning approach consists in a penalized maximum likelihood estimation carried out by a robust expectation-maximization (EM) algorithm for fitting polynomial, spline and B-spline regressions mixtures. The proposed learning approach is fully unsupervised: 1) it simultaneously infers the model parameters and the optimal number of the regression mixture components from the data as the learning proceeds, rather than in a two-fold scheme as in standard model-based clustering using afterward model selection criteria, and 2) it does not require accurate initialization unlike the standard EM for regression mixtures. The developed approach is applied to curve clustering problems. Numerical experiments on simulated data show that the proposed robust EM algorithm performs well and provides accurate results in terms of robustness with regard initialization and retrieving the optimal partition with the actual number of clusters. An application to real data in the framework of functional data clustering, confirms the benefit of the proposed approach for practical applications.

Machine learning embedded EM algorithms for semiparametric mixture regression models

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

Semiparametric Mixture Regression with Unspecified Error Distributions

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

A Novel Split and Merge EM Algorithm for Gaussian Mixture Model

Network EM Algorithm for Gaussian Mixture Model in Decentralized Federated Learning

Big Learning Expectation Maximization

Nonlinear Variational Bayesian Student’s-t Mixture Regression and Inferential Sensor Application with Semisupervised Data

Competitive EM Algorithm for Finite Mixture Models

The Competitive EM Algorithm for Gaussian Mixtures with BYY Harmony Criterion

A modified EM-type algorithm to estimate semi-parametric mixtures of non-parametric regressions

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes

Double Machine Learning for Partially Linear Mixed-Effects Models with Repeated Measurements

Unsupervised learning of regression mixture models with unknown number of components

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

Sequential Estimation for Mixture of Regression Models for Heterogeneous Population

A Robust and Flexible EM Algorithm for Mixtures of Elliptical Distributions with Missing Data

Leveraging independence in high-dimensional mixed linear regression

A Nonparametric Estimation Method for the Multivariate Mixture Models

An adaptive simulated annealing EM algorithm for inference on non-homogeneous hidden Markov models