Abstract:The two parameter Poisson-Dirichlet Process (PDP), a generalisation of the Dirichlet Process, is increasingly being used for probabilistic modelling in discrete areas such as language technology, bioinformatics, and image analysis. There is a rich literature about the PDP and its derivative distributions such as the Chinese Restaurant Process (CRP). This article reviews some of the basic theory and then the major results needed for Bayesian modelling of discrete problems including details of priors, posteriors and computation. The PDP allows one to build distributions over countable partitions. The PDP has two other remarkable properties: first it is partially conjugate to itself, which allows one to build hierarchies of PDPs, and second using a marginalised relative the CRP, one gets fragmentation and clustering properties that lets one layer partitions to build trees. This article presents the basic theory for understanding the notion of partitions and distributions over them, the PDP and the CRP, and the important properties of conjugacy, fragmentation and clustering, as well as some key related properties such as consistency and convergence. This article also presents a Bayesian interpretation of the Poisson-Dirichlet process based on an improper and infinite dimensional Dirichlet distribution. This means we can understand the process as just another Dirichlet and thus all its sampling properties emerge naturally. The theory of PDPs is usually presented for continuous distributions (more generally referred to as non-atomic distributions), however, when applied to discrete distributions its remarkable conjugacy property emerges. This context and basic results are also presented, as well as techniques for computing the second order Stirling numbers that occur in the posteriors for discrete distributions.

Large sample asymptotics for the two-parameter Poisson--Dirichlet process

Large deviations for Dirichlet processes and Poisson-Dirichlet distributions with two parameters

On Large Increments of Infinite Series of Ornstein-Uhlenbeck Processes

ON LARGE INCREMENTS OF L P VALUED GAUSSIAN PROCESSES

LIMIT BEHAVIORS FOR THE INCREMENTS OF A D-Dimensional MULTI-PARAMETER GAUSSIAN PROCESS

Sample-Path Large Deviations for Lévy Processes and Random Walks with Lognormal Increments

On Large Increments of a Two-Parameter Fractional Wiener Process

Central limit theorems associated with the hierarchical Dirichlet process

On large increments and liminfs of a two-parameter Gaussian process

Dual process in the two-parameter Poisson-Dirichlet diffusion

A Two-Parameter Family of Infinite-Dimensional Diffusions in the Kingman Simplex

Moderate, large and super large deviations principles for Poisson process with uniform catastrophes

Limiting Behaviour of Poisson-Dirichlet and Generalised Poisson-Dirichlet Distributions

Large Deviations for Empirical Processes of Interacting Particle Systems

Higher order asymptotics for large deviations -- Part I

On asymptotic properties of high moments of compound Poisson distribution

A Bayesian View of the Poisson-Dirichlet Process

A complete characterization of a correlated Bernoulli process

Asymptotics for sums of random variables with local subexponential behaviour

Nonlinear stochastic Laplace equation: Large Deviations and Measure Concentration

Bernstein -- von Mises theorems for statistical inverse problems II: Compound Poisson processes