Abstract:Dirichlet process mixture (DPM) model is one of the most important Bayesian nonparametric models owing to its efficiency of inference and flexibility for various applications. A fundamental assumption made by DPM model is that all data items are generated from a single, shared DP. This assumption, however, is restrictive in many practical settings where samples are generated from a collection of dependent DPs, each associated with a point in some covariate space. For example, documents in the proceedings of a conference are organized by year, or photos may be tagged and recorded with GPS locations. We present a general method for constructing dependent Dirichlet processes (DP) on arbitrary covariate space. The approach is based on restricting and projecting a DP defined on a space of continuous functions with different domains, which results in a collection of dependent random measures, each associated with a point in covariate space and is marginally DP distributed. The constructed collection of dependent DPs can be used as a nonparametric prior of infinite dynamic mixture models, which allow each mixture component to appear/disappear and vary in a subspace of covariate space. Furthermore, we discuss choices of base distributions of functions in a variety of settings as a flexible method to control dependencies. In addition, we develop an efficient Gibbs sampler for model inference where all underlying random measures are integrated out. Finally, experiment results on temporal modeling and spatial modeling datasets demonstrate the effectiveness of the method in modeling dynamic mixture models on different types of covariates.

Estimation of Dirichlet Process Priors with Monotone Missing Data

Estimation of Poisson-Dirichlet Parameters with Monotone Missing Data

On Several Estimates to the Precision Parameter of Dirichlet Process Prior.

Horseshoe Priors for Sparse Dirichlet-Multinomial Models

Does dirichlet prior smoothing solve the Shannon entropy estimation problem?

Truncated Poisson–Dirichlet approximation for Dirichlet process hierarchical models

A Study for Missing Values in Pinar(1)(T) Processes

Estimation of Time-Varying Unknown Nongaussian Noise with Dpm

Functional Dirichlet Process.

Dirichlet Process Mixture of Generalized Inverted Dirichlet Distributions for Positive Vector Data with Extended Variational Inference

Adaptive Bayesian multivariate density estimation with Dirichlet mixtures

Dirichlet process mixtures of block $g$ priors for model selection and prediction in linear models

Estimation of single index model with missing response at random

Asymptotic properties of Dirichlet kernel density estimators

Smoothed Hierarchical Dirichlet Process: A Non-Parametric Approach to Constraint Measures

Maximum likelihood estimation of missing data probability for nonmonotone missing at random data

Nonparametric intensity estimation from noisy observations of a Poisson process under unknown error distribution

Semiparametric Double Robust and Efficient Estimation for Mean Functionals with Response Missing at Random

Discrete parametric graphical models with Dirichlet type priors

Unsupervised Learning of Dirichlet Process Mixture Models with Missing Data

Piecewise monotone estimation in one-parameter exponential family