Abstract:The purpose of this paper is twofold. First, we propose a novel algorithm for estimating parameters in one-dimensional Gaussian mixture models (GMMs). The algorithm takes advantage of the Hankel structure inherent in the Fourier data obtained from independent and identically distributed (i.i.d) samples of the mixture. For GMMs with a unified variance, a singular value ratio functional using the Fourier data is introduced and used to resolve the variance and component number simultaneously. The consistency of the estimator is derived. Compared to classic algorithms such as the method of moments and the maximum likelihood method, the proposed algorithm does not require prior knowledge of the number of Gaussian components or good initial guesses. Numerical experiments demonstrate its superior performance in estimation accuracy and computational cost. Second, we reveal that there exists a fundamental limit to the problem of estimating the number of Gaussian components or model order in the mixture model if the number of i.i.d samples is finite. For the case of a single variance, we show that the model order can be successfully estimated only if the minimum separation distance between the component means exceeds a certain threshold value and can fail if below. We derive a lower bound for this threshold value, referred to as the computational resolution limit, in terms of the number of i.i.d samples, the variance, and the number of Gaussian components. Numerical experiments confirm this phase transition phenomenon in estimating the model order. Moreover, we demonstrate that our algorithm achieves better scores in likelihood, AIC, and BIC when compared to the EM algorithm.

A generalized Budan-Fourier approach to generalized Gaussian and exponential mixtures

Gaussian mixture density modeling and decomposition with weighted likelihood

Bayesian estimation and prediction for certain mixtures

A Generalized Finite Mixture Model for Asymmetric Probability Distribution Observations

On the best approximation by finite Gaussian mixtures

Probabilistic Inference from Arbitrary Uncertainty using Mixtures of Factorized Generalized Gaussians

Product of Gaussian Mixture Diffusion Models

Differentiability and Approximation of Probability Functions under Gaussian Mixture Models: A Bayesian Approach

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

The Gaussian approximation for multi-color generalized Friedman’s urn model

Density Parameter Estimation for Additive Cauchy-Gaussian Mixture

Universality laws for Gaussian mixtures in generalized linear models*

A Specialized Probability Density Function for the Input of Mixture of Gaussian Processes.

Model-based clustering based on sparse finite Gaussian mixtures

A smoothed semiparametric likelihood for estimation of nonparametric finite mixture models with a copula-based dependence structure

Continuous Gaussian mixture solution for linear Bayesian inversion with application to Laplace priors

A Fourier Approach to the Parameter Estimation Problem for One-dimensional Gaussian Mixture Models

Probabilistic Classifiers with a Generalized Gaussian Scale Mixture Prior

Mixture of Gaussian Processes and its Applications

Learning Probability Density Functions from Marginal Distributions with Applications to Gaussian Mixtures