Abstract:Dirichlet process mixture (DPM) model is one of the most important Bayesian nonparametric models owing to its efficiency of inference and flexibility for various applications. A fundamental assumption made by DPM model is that all data items are generated from a single, shared DP. This assumption, however, is restrictive in many practical settings where samples are generated from a collection of dependent DPs, each associated with a point in some covariate space. For example, documents in the proceedings of a conference are organized by year, or photos may be tagged and recorded with GPS locations. We present a general method for constructing dependent Dirichlet processes (DP) on arbitrary covariate space. The approach is based on restricting and projecting a DP defined on a space of continuous functions with different domains, which results in a collection of dependent random measures, each associated with a point in covariate space and is marginally DP distributed. The constructed collection of dependent DPs can be used as a nonparametric prior of infinite dynamic mixture models, which allow each mixture component to appear/disappear and vary in a subspace of covariate space. Furthermore, we discuss choices of base distributions of functions in a variety of settings as a flexible method to control dependencies. In addition, we develop an efficient Gibbs sampler for model inference where all underlying random measures are integrated out. Finally, experiment results on temporal modeling and spatial modeling datasets demonstrate the effectiveness of the method in modeling dynamic mixture models on different types of covariates.

Revisiting Dirichlet Mixture Model: unraveling deeper insights and practical applications

Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Dirichlet Process Mixture Model, Extensions and Applications

Mixture Models With a Prior on the Number of Components

Functional Dirichlet Process.

Multimode process data modeling: A Dirichlet process mixture model based Bayesian robust factor analyzer approach

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

Sampling from Dirichlet process mixture models with unknown concentration parameter: Mixing issues in large data implementations

Dirichlet distribution parameter estimation with applications in microbiome analyses

The Infinite Student'S T-Mixture For Robust Modeling

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Deep Dirichlet process mixture models.

Dirichlet compound negative multinomial mixture models and applications

A Dirichlet Process Mixture Model of Discrete Choice

Nonparametric Bayesian Methods (Dirichlet Process Mixtures)

A Generalized Finite Mixture Model for Asymmetric Probability Distribution Observations

Sequential Learning for Dirichlet Process Mixtures

Markov Chain Sampling Methods for Dirichlet Process Mixture Models

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

Additive mixed models with approximate Dirichlet process mixtures: the EM approach