Abstract:The purpose of this paper is twofold. First, we propose a novel algorithm for estimating parameters in one-dimensional Gaussian mixture models (GMMs). The algorithm takes advantage of the Hankel structure inherent in the Fourier data obtained from independent and identically distributed (i.i.d) samples of the mixture. For GMMs with a unified variance, a singular value ratio functional using the Fourier data is introduced and used to resolve the variance and component number simultaneously. The consistency of the estimator is derived. Compared to classic algorithms such as the method of moments and the maximum likelihood method, the proposed algorithm does not require prior knowledge of the number of Gaussian components or good initial guesses. Numerical experiments demonstrate its superior performance in estimation accuracy and computational cost. Second, we reveal that there exists a fundamental limit to the problem of estimating the number of Gaussian components or model order in the mixture model if the number of i.i.d samples is finite. For the case of a single variance, we show that the model order can be successfully estimated only if the minimum separation distance between the component means exceeds a certain threshold value and can fail if below. We derive a lower bound for this threshold value, referred to as the computational resolution limit, in terms of the number of i.i.d samples, the variance, and the number of Gaussian components. Numerical experiments confirm this phase transition phenomenon in estimating the model order. Moreover, we demonstrate that our algorithm achieves better scores in likelihood, AIC, and BIC when compared to the EM algorithm.

Parameter estimation for stable distributions and their mixture

Bayesian estimation and prediction for certain mixtures

Parsimony and parameter estimation for mixtures of multivariate leptokurtic-normal distributions

A Nonparametric Estimation Method for the Multivariate Mixture Models

Nonparametric estimation of a mixing distribution for a family of linear stochastic dynamical systems

Estimation and Hypothesis-Testing in Finite Mixture-Models

A novel approach for parameter estimation of mixture of two Weibull distributions in failure data modeling

Parameter estimation of α-stable distributions using DRAM algorithm

A Nonparametric, Mixed Effect, Maximum Likelihood Estimator for the Distribution of Random Parameters in Discrete-Time Abstract Parabolic Systems with Application to the Transdermal Transport of Alcohol

Parameter Estimation Of Positive Alpha-Stable Distribution Based On Negative-Order Moments

The Improved Moment-Type Methods For The Parameters Estimation Of The Gaussian And Symmetric Alpha Stable Distributions Based On Empirical Characteristic Function

Statistical inference for a mixture of Markov jump processes

Prohorov Metric-Based Nonparametric Estimation of the Distribution of Random Parameters in Abstract Parabolic Systems with Application to the Transdermal Transport of Alcohol

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

Parameter Estimation by Hellinger Type Distance for Multivariate Distributions Based Upon Probability Generating Functions

Sequential Estimation for Mixture of Regression Models for Heterogeneous Population

A Fourier Approach to the Parameter Estimation Problem for One-dimensional Gaussian Mixture Models

Robust mixture of regression models using the symmetric α-stable distribution

Nonparametric estimation of the mixing density using polynomials

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

A Novelty Bayesian Method For Parameters Estimation And Model Selection