Abstract:Bayesian likelihood-free inference, which is used to perform Bayesian inference when the likelihood is intractable, enjoys an increasing number of important scientific applications. However, many aspects of a Bayesian analysis become more challenging in the likelihood-free setting. One example of this is prior-data conflict checking, where the goal is to assess whether the information in the data and the prior are inconsistent. Conflicts of this kind are important to detect, since they may reveal problems in an investigator's understanding of what are relevant values of the parameters, and can result in sensitivity of Bayesian inferences to the prior. Here we consider methods for prior-data conflict checking which are applicable regardless of whether the likelihood is tractable or not. In constructing our checks, we consider checking statistics based on prior-to-posterior Kullback-Leibler divergences. The checks are implemented using mixture approximations to the posterior distribution and closed-form approximations to Kullback-Leibler divergences for mixtures, which make Monte Carlo approximation of reference distributions for calibration computationally feasible. When prior-data conflicts occur, it is useful to consider weakly informative prior specifications in alternative analyses as part of a sensitivity analysis. As a main application of our methodology, we develop a technique for searching for weakly informative priors in likelihood-free inference, where the notion of a weakly informative prior is formalized using prior-data conflict checks. The methods are demonstrated in three examples.

Optimal Robustness Results for Some Bayesian Procedures and the Relationship to Prior-Data Conflict

Improving Robust Decisions with Data

Robust Bayesian Reliability for Complex Systems under Prior-Data Conflict

Weakly informative priors and prior-data conflict checking for likelihood-free inference

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Robust Bayesian Inference for Berkson and Classical Measurement Error Models

Likelihood distortion and Bayesian local robustness

Robust Stochastic Optimization with Rare-Event Modeling

Bayesian Nonparametrics Meets Data-Driven Distributionally Robust Optimization

How Does Bayes Error Limit Probabilistic Robust Accuracy

Probabilistic Robustness Analysis—Risks, Complexity, and Algorithms

Adversarial robustness of amortized Bayesian inference

Distributional Robustness Bounds Generalization Errors

Robust portfolio asset allocation and risk measures

Robust Optimization for Non-Convex Objectives

Learning-Based Robust Optimization: Procedures and Statistical Guarantees

A Statistical Theory for the Analysis of Uncertain Systems

A New Statistical Approach for the Analysis of Uncertain Systems

Iterative importance sampling with Markov chain Monte Carlo sampling in robust Bayesian analysis

Robust satisficing and the probability of survival

A Bayesian Risk Approach to Data-driven Stochastic Optimization: Formulations and Asymptotics