Abstract:Mixture modeling using elliptical distributions promises enhanced robustness, flexibility, and stability over the widely employed Gaussian mixture model (GMM). However, existing studies based on the elliptical mixture model (EMM) are restricted to several specific types of elliptical probability density functions, which are not supported by general solutions or systematic analysis frameworks; this significantly limits the rigor in the design and power of EMMs in applications. To this end, we propose a novel general framework for estimating and analyzing the EMMs, achieved through the Riemannian manifold optimization. First, we investigate the relationships between Riemannian manifolds and elliptical distributions, and the so established connection between the original manifold and a reformulated one indicates a mismatch between these manifolds, a major cause of failure of the existing optimization for solving general EMMs. We next propose a universal solver that is based on the optimization of a redesigned cost and prove the existence of the same optimum as in the original problem; this is achieved in a simple, fast and stable way. We further calculate the influence functions of the EMM as theoretical bounds to quantify robustness to outliers. Comprehensive numerical results demonstrate the ability of the proposed framework to accommodate EMMs with different properties of individual functions in a stable way and with fast convergence speed. Finally, the enhanced robustness and flexibility of the proposed framework over the standard GMM are demonstrated both analytically and through comprehensive simulations.

Manifold Optimization for Gaussian Mixture Models

Manifold Optimization Assisted Gaussian Variational Approximation

A Riemannian Newton Trust-Region Method for Fitting Gaussian Mixture Models

Refining Gaussian Mixture Model Based on Enhanced Manifold Learning.

A Universal Framework for Learning the Elliptical Mixture Model

Stochastic first-order learning for large-scale flexibly tied Gaussian mixture models

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

A New Gaussian Mixture Model Optimization Method

Manifold-based transformation of the probability distribution for convergence in optimization

Manifold Gaussian Variational Bayes on the Precision Matrix

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

Ensemble Manifold Regularization

Parameter Estimation for Gaussian Mixture Processes Based on Expectation-Maximization Method

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

A Nonparametric Model for Multi-Manifold Clustering with Mixture of Gaussians and Graph Consistency

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes

Stochastic First-Order Learning for Large-Scale Flexibly Tied Gaussian Mixture Model

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

Convergence of Gradient EM on Multi-component Mixture of Gaussians.

Manifold Gaussian Processes for Regression