Abstract:This study revisits the Dirichlet Mixture Model (DMM), offering comprehensive insights into specific facets of parameter estimation. Estimating parameters of the DMM is challenging, with previous approaches focusing on standard parametrization, which lacks interpretability. We propose an alternative parametrization of the Dirichlet distribution using mean and precision, which provides critical insights into the distribution's location and peakedness. This parametrization is versatile, covering a wide range of scenarios with varying locations and precision levels, making it applicable to diverse datasets. Depending on whether one or both parameters are unknown, the estimation procedure varies, and estimates also differ when precision is identical across mixture components. In this article, we introduce this alternative parametrization and meticulously explore four distinct scenarios, deriving maximum likelihood estimates (MLE) for each using the Expectation-Maximization (EM) algorithm. For high-dimensional data, where standard methods often falter due to additional challenges, we present an innovative estimation approach utilizing Stirling's approximation and moment approximation, which provides closed-form solutions and faster execution times. Our study demonstrates the identifiability of the DMM and employs a closed-form approximation for Kullback–Leibler (KL) divergence to evaluate goodness of fit. Practical applications are illustrated through the analysis of both simulated and real datasets, showcasing the practical utility of the DMM.

Divide and Recombine for Large and Complex Data: Model Likelihood Functions using MCMC

Gaussian mixture density modeling and decomposition with weighted likelihood

parallelMCMCcombine: An R Package for Bayesian Methods for Big Data and Analytics

Divide-and-Conquer MCMC for Multivariate Binary Data

Multilevel Dimension-Independent Likelihood-Informed MCMC for Large-Scale Inverse Problems

A rare event approach to high dimensional Approximate Bayesian computation

Inference for High-Dimensional Linear Mixed-Effects Models: A Quasi-Likelihood Approach

An easy-to-use empirical likelihood ABC method

Analysis of multivariate Gaussian mixture model based on DRJMCMC method

Revisiting Dirichlet Mixture Model: unraveling deeper insights and practical applications

Information Splitting for Big Data Analytics

Computing log-likelihood and its derivatives for restricted maximum likelihood methods

Diffusion Generative Modelling for Divide-and-Conquer MCMC

Restricted maximum likelihood estimation in generalized linear mixed models

Sparse high-dimensional linear mixed modeling with a partitioned empirical Bayes ECM algorithm

Diversity-Promoting Bayesian Learning of Latent Variable Models.

Parallel Markov Chain Monte Carlo for Non-Gaussian Posterior Distributions

A Likelihood Ratio Framework for High Dimensional Semiparametric Regression

Parsimonious and Efficient Likelihood Composition by Gibbs Sampling

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications