Abstract:Most statistical modeling applications involve the consideration of a candidate collection of models based on various sets of explanatory variables. The candidate models may also differ in terms of the structural formulations for the systematic component and the posited probability distributions for the random component. A common practice is to use an information criterion to select a model from the collection that provides an optimal balance between fidelity to the data and parsimony. The analyst then typically proceeds as if the chosen model was the only model ever considered. However, such a practice fails to account for the variability inherent in the model selection process, which can lead to inappropriate inferential results and conclusions. In recent years, inferential methods have been proposed for multimodel frameworks that attempt to provide an appropriate accounting of modeling uncertainty. In the frequentist paradigm, such methods should ideally involve model selection probabilities, i.e., the relative frequencies of selection for each candidate model based on repeated sampling. Model selection probabilities can be conveniently approximated through bootstrapping. When the Akaike information criterion is employed, Akaike weights are also commonly used as a surrogate for selection probabilities. In this work, we show that the conventional bootstrap approach for approximating model selection probabilities is impacted by bias. We propose a simple correction to adjust for this bias. We also argue that Akaike weights do not provide adequate approximations for selection probabilities, although they do provide a crude gauge of model plausibility.

Bootstrap Markov chain Monte Carlo and optimal solutions for the Law of Categorical Judgment (Corrected)

Optimal approximating Markov chains for Bayesian inference

A Bootstrap Algebraic Multilevel Method for Markov Chains

Scalable Nonparametric Sampling from Multimodal Posteriors with the Posterior Bootstrap

Bootstrap Approximation of Model Selection Probabilities for Multimodel Inference Frameworks

Bootstrap inference after using multiple queries for model selection

A fresh take on 'Barker dynamics' for MCMC

Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation

Stochastic Gradient Markov Chain Monte Carlo

A Discontinuity Adjustment for Subdistribution Function Confidence Bands Applied to Right-Censored Competing Risks Data (with Erratum)

Optimal Ricci curvature Markov chain Monte Carlo methods on finite states

Bootstrap Inference on Partially Linear Binary Choice Model

Accelerating delayed-acceptance Markov chain Monte Carlo algorithms

Exactly Optimal Quickest Change Detection of Markov Chains

Bootstrap, Markov Chain Monte Carlo, and LP/SDP Hierarchy for the Lattice Ising Model

Adaptive, delayed-acceptance MCMC for targets with expensive likelihoods

An invitation to adaptive Markov chain Monte Carlo convergence theory

Markov Chain Monte Carlo and Variational Inference: Bridging the Gap

Markov chain Monte Carlo Methods For Lattice Gaussian Sampling:Convergence Analysis and Enhancement

Scalable Monte Carlo for Bayesian Learning

Rate-Adaptive Bootstrap For Possibly Misspecified Gmm