Abstract:This study revisits the Dirichlet Mixture Model (DMM), offering comprehensive insights into specific facets of parameter estimation. Estimating parameters of the DMM is challenging, with previous approaches focusing on standard parametrization, which lacks interpretability. We propose an alternative parametrization of the Dirichlet distribution using mean and precision, which provides critical insights into the distribution's location and peakedness. This parametrization is versatile, covering a wide range of scenarios with varying locations and precision levels, making it applicable to diverse datasets. Depending on whether one or both parameters are unknown, the estimation procedure varies, and estimates also differ when precision is identical across mixture components. In this article, we introduce this alternative parametrization and meticulously explore four distinct scenarios, deriving maximum likelihood estimates (MLE) for each using the Expectation-Maximization (EM) algorithm. For high-dimensional data, where standard methods often falter due to additional challenges, we present an innovative estimation approach utilizing Stirling's approximation and moment approximation, which provides closed-form solutions and faster execution times. Our study demonstrates the identifiability of the DMM and employs a closed-form approximation for Kullback–Leibler (KL) divergence to evaluate goodness of fit. Practical applications are illustrated through the analysis of both simulated and real datasets, showcasing the practical utility of the DMM.

Parameters Estimation for a Mixture of Several Exponential Distributions with Two Parameters

Parameter Estimation in Exponential Models by Linear and Nonlinear Fitting Methods.

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Bayesian estimation and prediction for certain mixtures

Dose-Response Curve Estimation: A Semiparametric Mixture Approach

Additive mixed models with approximate Dirichlet process mixtures: the EM approach

A novel approach for parameter estimation of mixture of two Weibull distributions in failure data modeling

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

Parameter estimation for stable distributions and their mixture

DNA-binding proteins and their cis-acting sites controlling hormonal induction of a mouse beta-casein::CAT fusion protein in mammary epithelial cells.

Model Selection for Exponential Power Mixture Regression Models

A Generalized Finite Mixture Model for Asymmetric Probability Distribution Observations

TLS-EM Algorithm of Mixture Density Models for Exponential Families

Estimating mixed-effects state-space models via particle filters and the EM algorithm

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

Sequential Estimation for Mixture of Regression Models for Heterogeneous Population

Revisiting Dirichlet Mixture Model: unraveling deeper insights and practical applications

A Two-Layer Mixture Model of Gaussian Process Functional Regressions and Its MCMC EM Algorithm

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

Conditional mixture modeling and model-based clustering

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes