Abstract:There has been an increasing interest on summary-free versions of approximate Bayesian computation (ABC), which replace distances among summaries with discrepancies between the empirical distributions of the observed data and the synthetic samples generated under the proposed parameter values. The success of these solutions has motivated theoretical studies on the limiting properties of the induced posteriors. However, current results (i) are often tailored to a specific discrepancy, (ii) require, either explicitly or implicitly, regularity conditions on the data generating process and the assumed statistical model, and (iii) yield bounds depending on sequences of control functions that are not made explicit. As such, there is the lack of a theoretical framework that (i) is unified, (ii) facilitates the derivation of limiting properties that hold uniformly, and (iii) relies on verifiable assumptions that provide concentration bounds clarifying which factors govern the limiting behavior of the ABC posterior. We address this gap via a novel theoretical framework that introduces the concept of Rademacher complexity in the analysis of the limiting properties for discrepancy-based ABC posteriors. This yields a unified theory that relies on constructive arguments and provides more informative asymptotic results and uniform concentration bounds, even in settings not covered by current studies. These advancements are obtained by relating the properties of summary-free ABC posteriors to the behavior of the Rademacher complexity associated with the chosen discrepancy within the family of integral probability semimetrics. This family extends summary-based ABC, and includes the Wasserstein distance and maximum mean discrepancy (MMD), among others. As clarified through a focus on the MMD case and via illustrative simulations, this perspective yields an improved understanding of summary-free ABC.

Discrepancy estimates for variance bounding Markov chain quasi-Monte Carlo

A weighted Discrepancy Bound of quasi-Monte Carlo Importance Sampling

Explicit error bounds for lazy reversible Markov Chain Monte Carlo

Error bounds for computing the expectation by Markov chain Monte Carlo

Statistical guarantees for stochastic Metropolis-Hastings

Convergence Speed and Approximation Accuracy of Numerical MCMC

Asymptotic bias of inexact Markov Chain Monte Carlo methods in high dimension

A large deviation principle for the empirical measures of Metropolis–Hastings chains

A large deviation principle for the empirical measures of Metropolis-Hastings chains

Forward Propagation of Low Discrepancy Through McKean-Vlasov Dynamics: From QMC to MLQMC

Geometric ergodicity of trans-dimensional Markov chain Monte Carlo algorithms

Quantifying Uncertainty in Transdimensional Markov Chain Monte Carlo Using Discrete Markov Models

A non-asymptotic error analysis for parallel Monte Carlo estimation from many short Markov chains

Markov Chain Variance Estimation: A Stochastic Approximation Approach

Unbiased Markov chain quasi-Monte Carlo for Gibbs samplers

Drift, Minorization, and Hitting Times

No Free Lunch for Approximate MCMC

A rate-distortion framework for MCMC algorithms: geometry and factorization of multivariate Markov chains

Bounding Wasserstein distance with couplings

Concentration of discrepancy-based approximate Bayesian computation via Rademacher complexity

Discussion of "Sequential Quasi-Monte Carlo" by Mathieu Gerber and Nicolas Chopin