Abstract:There has been an increasing interest on summary-free versions of approximate Bayesian computation (ABC), which replace distances among summaries with discrepancies between the empirical distributions of the observed data and the synthetic samples generated under the proposed parameter values. The success of these solutions has motivated theoretical studies on the limiting properties of the induced posteriors. However, current results (i) are often tailored to a specific discrepancy, (ii) require, either explicitly or implicitly, regularity conditions on the data generating process and the assumed statistical model, and (iii) yield bounds depending on sequences of control functions that are not made explicit. As such, there is the lack of a theoretical framework that (i) is unified, (ii) facilitates the derivation of limiting properties that hold uniformly, and (iii) relies on verifiable assumptions that provide concentration bounds clarifying which factors govern the limiting behavior of the ABC posterior. We address this gap via a novel theoretical framework that introduces the concept of Rademacher complexity in the analysis of the limiting properties for discrepancy-based ABC posteriors. This yields a unified theory that relies on constructive arguments and provides more informative asymptotic results and uniform concentration bounds, even in settings not covered by current studies. These advancements are obtained by relating the properties of summary-free ABC posteriors to the behavior of the Rademacher complexity associated with the chosen discrepancy within the family of integral probability semimetrics. This family extends summary-based ABC, and includes the Wasserstein distance and maximum mean discrepancy (MMD), among others. As clarified through a focus on the MMD case and via illustrative simulations, this perspective yields an improved understanding of summary-free ABC.

A new Bayesian discrepancy measure

A Bayesian Measure of Model Accuracy

An inferential measure of dependence between two systems using Bayesian model comparison

Bayesian model comparison with the Hyvärinen score: computation and consistency

A frequentist two-sample test based on Bayesian model selection

A Parzen-based distance between probability measures as an alternative of summary statistics in Approximate Bayesian Computation

Concentration of discrepancy-based approximate Bayesian computation via Rademacher complexity

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

A puzzle of proportions: Two popular Bayesian tests can yield dramatically different conclusions

The Polynomial Stein Discrepancy for Assessing Moment Convergence

A new Bayesian two-sample t-test for effect size estimation under uncertainty based on a two-component Gaussian mixture with known allocations and the region of practical equivalence

A probabilistic graphical model for assessing equivocal evidence

A Bayesian interpretation of inconsistency measures in cosmology

Empirical Bayes factors for common hypothesis tests

The distribution of Bayes' ratio

A nonparametric Bayesian test of dependence

Bayesian, frequentist and fiducial intervals for the difference between two binomial proportions

A Bayesian Approach To Histogram Comparison

Discrepancy Measures for Global Sensitivity Analysis

Doublethink: simultaneous Bayesian-frequentist model-averaged hypothesis testing

Bayesian penalty methods for evaluating measurement invariance in moderated nonlinear factor analysis.