Abstract:The two parameter Poisson-Dirichlet Process (PDP), a generalisation of the Dirichlet Process, is increasingly being used for probabilistic modelling in discrete areas such as language technology, bioinformatics, and image analysis. There is a rich literature about the PDP and its derivative distributions such as the Chinese Restaurant Process (CRP). This article reviews some of the basic theory and then the major results needed for Bayesian modelling of discrete problems including details of priors, posteriors and computation. The PDP allows one to build distributions over countable partitions. The PDP has two other remarkable properties: first it is partially conjugate to itself, which allows one to build hierarchies of PDPs, and second using a marginalised relative the CRP, one gets fragmentation and clustering properties that lets one layer partitions to build trees. This article presents the basic theory for understanding the notion of partitions and distributions over them, the PDP and the CRP, and the important properties of conjugacy, fragmentation and clustering, as well as some key related properties such as consistency and convergence. This article also presents a Bayesian interpretation of the Poisson-Dirichlet process based on an improper and infinite dimensional Dirichlet distribution. This means we can understand the process as just another Dirichlet and thus all its sampling properties emerge naturally. The theory of PDPs is usually presented for continuous distributions (more generally referred to as non-atomic distributions), however, when applied to discrete distributions its remarkable conjugacy property emerges. This context and basic results are also presented, as well as techniques for computing the second order Stirling numbers that occur in the posteriors for discrete distributions.

Bayesian prediction for stochastic processes. Theory and applications

On Bounded Stochastic Processes

Bayesian estimation and prediction for certain mixtures

Bayesian Prediction for the Two-Parameter Exponential Distribution Based on Type II Doubly Censoring

Bayesian Prediction With Linear Dynamic Model: Principle And Application

Stochastic Differential Equations with Variational Wishart Diffusions

Bayesian inference for Matérn repulsive processes

Predicting path-dependent processes by deep learning

Nonparametric Bayesian inference for stochastic processes with piecewise constant priors

Nonparametric Bayesian inference of discretely observed diffusions

Bayesian estimation of nonlinear Hawkes process

A Bayesian View of the Poisson-Dirichlet Process

Bayesian and non-Bayesian two-sample prediction for the Fréchet distribution under progressive type II censoring

Predictive updating methods with application to Bayesian classification

Stochastic Differential Equations Driven by Fractional Brownian Motion and Poisson Point Process

Expectation propagation for continuous time stochastic processes

A continuation method in Bayesian inference

Stochastic Model Predictive Control Utilizing Bayesian Neural Networks

Double-Chain Unscented Expectation Propagation for Inference in Stochastic Dynamical Models of Biological Processes.

On classical and Bayesian inference for bivariate Poisson conditionals distributions: Theory, methods and applications

The semi-Markov beta-Stacy process: a Bayesian non-parametric prior for semi-Markov processes