Abstract:This article presents a novel, general, and effective simulation-inspired approach, called {\it repro samples method}, to conduct statistical inference. The approach studies the performance of artificial samples, referred to as {\it repro samples}, obtained by mimicking the true observed sample to achieve uncertainty quantification and construct confidence sets for parameters of interest with guaranteed coverage rates. Both exact and asymptotic inferences are developed. An attractive feature of the general framework developed is that it does not rely on the large sample central limit theorem and is likelihood-free. As such, it is thus effective for complicated inference problems which we can not solve using the large sample central limit theorem. The proposed method is applicable to a wide range of problems, including many open questions where solutions were previously unavailable, for example, those involving discrete or non-numerical parameters. To reduce the large computational cost of such inference problems, we develop a unique matching scheme to obtain a data-driven candidate set. Moreover, we show the advantages of the proposed framework over the classical Neyman-Pearson framework. We demonstrate the effectiveness of the proposed approach on various models throughout the paper and provide a case study that addresses an open inference question on how to quantify the uncertainty for the unknown number of components in a normal mixture model. To evaluate the empirical performance of our repro samples method, we conduct simulations and study real data examples with comparisons to existing approaches. Although the development pertains to the settings where the large sample central limit theorem does not apply, it also has direct extensions to the cases where the central limit theorem does hold.

The adaptive interpolation method: a simple scheme to prove replica formulas in Bayesian inference

The adaptive interpolation method for proving replica formulas. Applications to the Curie–Weiss and Wigner spike models

Replica symmetry breaking in neural networks: a few steps toward rigorous results

Generic proving of replica symmetry breaking

Bayesian Interpolation

Statistical limits of dictionary learning: random matrix theory and the spectral replica method

Rank-one matrix estimation: analysis of algorithmic and information theoretic limits by the spatial coupling method

Exact Fractional Inference via Re-Parametrization & Interpolation between Tree-Re-Weighted- and Belief Propagation- Algorithms

Informed reversible jump algorithms

Strong replica symmetry for high-dimensional disordered log-concave Gibbs measures

New Understanding of the Bethe Approximation and the Replica Method

Reproducible Parameter Inference Using Bagged Posteriors

Replica bound for Ising spin glass models in one dimension

Repro Samples Method for Finite- and Large-Sample Inferences

Leveraging Self-Consistency for Data-Efficient Amortized Bayesian Inference

Replica analysis of Bayesian data clustering

Using Autodiff to Estimate Posterior Moments, Marginals and Samples

Replica Analysis of the Linear Model with Markov or Hidden Markov Signal Priors

Monte Carlo with kernel-based Gibbs measures: Guarantees for probabilistic herding

Scalable inference with Autoregressive Neural Ratio Estimation