Abstract:We consider generalized Bayesian inference on stochastic processes and dynamical systems with potentially long-range dependency. Given a sequence of observations, a class of parametrized model processes with a prior distribution, and a loss function, we specify the generalized posterior distribution. The problem of frequentist posterior consistency is concerned with whether as more and more samples are observed, the posterior distribution on parameters will asymptotically concentrate on the "right" parameters. We show that posterior consistency can be derived using a combination of classical large deviation techniques, such as Varadhan's lemma, conditional/quenched large deviations, annealed large deviations, and exponential approximations. We show that the posterior distribution will asymptotically concentrate on parameters that minimize the expected loss and a divergence term, and we identify the divergence term as the Donsker-Varadhan relative entropy rate from process-level large deviations. As an application, we prove new quenched and annealed large deviation asymptotics and new Bayesian posterior consistency results for a class of mixing stochastic processes. In the case of Markov processes, one can obtain explicit conditions for posterior consistency, whenever estimates for log-Sobolev constants are available, which makes our framework essentially a black box. We also recover state-of-the-art posterior consistency on classical dynamical systems with a simple proof. Our approach has the potential of proving posterior consistency for a wide range of Bayesian procedures in a unified way.

Stick-breaking processes with exchangeable length variables

Stick-Breaking processes, Clumping, and Markov Chain Occupation Laws

The transcoding sampler for stick-breaking inferences on Dirichlet process mixtures

Functional central limit theorems for stick-breaking priors

Generalized Species Sampling Priors with Latent Beta reinforcements

Stick-Breaking Variational Autoencoders

Stick-Breaking Dependent Beta Processes with Variational Inference

Coag-Frag duality for a class of stable Poisson-Kingman mixtures

Large Deviation Asymptotics and Bayesian Posterior Consistency on Stochastic Processes and Dynamical Systems

Latent nested nonparametric priors

Bridging the Gap: A Generalized Stochastic Process for Count Data

Sampling from Dirichlet process mixture models with unknown concentration parameter: Mixing issues in large data implementations

Scalable and adaptive variational Bayes methods for Hawkes processes

Mixing Times and Structural Inference for Bernoulli Autoregressive Processes

Dynamic sparsity on dynamic regression models

Bayesian Variable Selection in Double Generalized Linear Tweedie Spatial Process Models

Generalized cumulative shrinkage process priors with applications to sparse Bayesian factor analysis

Discrete sticky couplings of functional autoregressive processes

Nonparametric Bayesian inference for stochastic processes with piecewise constant priors

Piecewise deterministic sampling with splitting schemes

Contaminated Gibbs-type priors