Abstract:This study revisits the Dirichlet Mixture Model (DMM), offering comprehensive insights into specific facets of parameter estimation. Estimating parameters of the DMM is challenging, with previous approaches focusing on standard parametrization, which lacks interpretability. We propose an alternative parametrization of the Dirichlet distribution using mean and precision, which provides critical insights into the distribution's location and peakedness. This parametrization is versatile, covering a wide range of scenarios with varying locations and precision levels, making it applicable to diverse datasets. Depending on whether one or both parameters are unknown, the estimation procedure varies, and estimates also differ when precision is identical across mixture components. In this article, we introduce this alternative parametrization and meticulously explore four distinct scenarios, deriving maximum likelihood estimates (MLE) for each using the Expectation-Maximization (EM) algorithm. For high-dimensional data, where standard methods often falter due to additional challenges, we present an innovative estimation approach utilizing Stirling's approximation and moment approximation, which provides closed-form solutions and faster execution times. Our study demonstrates the identifiability of the DMM and employs a closed-form approximation for Kullback–Leibler (KL) divergence to evaluate goodness of fit. Practical applications are illustrated through the analysis of both simulated and real datasets, showcasing the practical utility of the DMM.

Moment-based dirac mixture approximation of circular densities

Optimal Reduction of Multivariate Dirac Mixture Densities

Universal Approximation on the Hypersphere

Density Parameter Estimation for Additive Cauchy-Gaussian Mixture

A mixture of ellipsoidal densities for 3D data modelling

Differentiability and Approximation of Probability Functions under Gaussian Mixture Models: A Bayesian Approach

Nearest Neighbor Dirichlet Mixtures

Method of Conditional Moments (MCM) for the Chemical Master Equation

A non-classical parameterization for density estimation using sample moments

von Mises Quasi-Processes for Bayesian Circular Regression

Adaptive Bayesian multivariate density estimation with Dirichlet mixtures

Posterior Contraction Rates for Deconvolution of Dirichlet-Laplace Mixtures

Revisiting Dirichlet Mixture Model: unraveling deeper insights and practical applications

The Circular Matern Covariance Function and its Link to Markov Random Fields on the Circle

Efficient Algorithms for Sparse Moment Problems without Separation

A Mixture of Linear-Linear Regression Models for Linear-Circular Regression

Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models

A likelihood ratio test for circular multimodality

Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$-Lifted Kullback--Leibler Divergence

Learning Probability Density Functions from Marginal Distributions with Applications to Gaussian Mixtures