Abstract:The two parameter Poisson-Dirichlet Process (PDP), a generalisation of the Dirichlet Process, is increasingly being used for probabilistic modelling in discrete areas such as language technology, bioinformatics, and image analysis. There is a rich literature about the PDP and its derivative distributions such as the Chinese Restaurant Process (CRP). This article reviews some of the basic theory and then the major results needed for Bayesian modelling of discrete problems including details of priors, posteriors and computation. The PDP allows one to build distributions over countable partitions. The PDP has two other remarkable properties: first it is partially conjugate to itself, which allows one to build hierarchies of PDPs, and second using a marginalised relative the CRP, one gets fragmentation and clustering properties that lets one layer partitions to build trees. This article presents the basic theory for understanding the notion of partitions and distributions over them, the PDP and the CRP, and the important properties of conjugacy, fragmentation and clustering, as well as some key related properties such as consistency and convergence. This article also presents a Bayesian interpretation of the Poisson-Dirichlet process based on an improper and infinite dimensional Dirichlet distribution. This means we can understand the process as just another Dirichlet and thus all its sampling properties emerge naturally. The theory of PDPs is usually presented for continuous distributions (more generally referred to as non-atomic distributions), however, when applied to discrete distributions its remarkable conjugacy property emerges. This context and basic results are also presented, as well as techniques for computing the second order Stirling numbers that occur in the posteriors for discrete distributions.

Polynomial birth-death distribution approximation in Wasserstein distance

Approximation of Sums of Locally Dependent Random Variables via Perturbation of Stein Operator

Poisson process approximation: From Palm theory to Stein's method

On Stein's factors for Poisson approximation in Wasserstein distance with non-linear transportation costs

On Brownian motion approximation of compound Poisson processes with applications to threshold models

An Algorithm for Computing the Distribution Function of the Generalized Poisson-Binomial Distribution

The generalized Poisson-binomial distribution and the computation of its distribution function

Wasserstein-p Bounds in the Central Limit Theorem Under Weak Dependence

ON PROBABILISTIC CONVERGENCE RATES OF STOCHASTIC BERNSTEIN POLYNOMIALS

Polynomial Distributions and Transformations

Wasserstein-$1$ distance and nonuniform Berry-Esseen bound for a supercritical branching process in a random environment

Wasserstein-p Bounds in the Central Limit Theorem Under Local Dependence

A new approach to posterior contraction rates via Wasserstein dynamics

The infimum values of the probability functions for some infinitely divisible distributions motivated by Chvátal's theorem

Optimal Wasserstein-$1$ distance between SDEs driven by Brownian motion and stable processes

Memory Efficient And Minimax Distribution Estimation Under Wasserstein Distance Using Bayesian Histograms

A Bayesian View of the Poisson-Dirichlet Process

An efficient Wasserstein-distance approach for reconstructing jump-diffusion processes using parameterized neural networks

Limits of sums for binomial and Eulerian numbers and their associated distributions

Bounding the -Distance Between One-Dimensional Continuous and Discrete Distributions via Stein's Method

A new infinitely divisible discrete distribution with applications to count data modeling