Abstract:This article presents a novel, general, and effective simulation-inspired approach, called {\it repro samples method}, to conduct statistical inference. The approach studies the performance of artificial samples, referred to as {\it repro samples}, obtained by mimicking the true observed sample to achieve uncertainty quantification and construct confidence sets for parameters of interest with guaranteed coverage rates. Both exact and asymptotic inferences are developed. An attractive feature of the general framework developed is that it does not rely on the large sample central limit theorem and is likelihood-free. As such, it is thus effective for complicated inference problems which we can not solve using the large sample central limit theorem. The proposed method is applicable to a wide range of problems, including many open questions where solutions were previously unavailable, for example, those involving discrete or non-numerical parameters. To reduce the large computational cost of such inference problems, we develop a unique matching scheme to obtain a data-driven candidate set. Moreover, we show the advantages of the proposed framework over the classical Neyman-Pearson framework. We demonstrate the effectiveness of the proposed approach on various models throughout the paper and provide a case study that addresses an open inference question on how to quantify the uncertainty for the unknown number of components in a normal mixture model. To evaluate the empirical performance of our repro samples method, we conduct simulations and study real data examples with comparisons to existing approaches. Although the development pertains to the settings where the large sample central limit theorem does not apply, it also has direct extensions to the cases where the central limit theorem does hold.

A Simple Resampling Method by Perturbing the Minimand

A Resampling Method Based on Pivotal Estimating Functions

Robust Minimax Estimation Based on Particle Swarm Optimization

Simple resampling methods for censored regression quantiles

A method to find an efficient and robust sampling strategy under model uncertainty

The resampling method via representative points

Subsampled Optimization: Statistical Guarantees, Mean Squared Error Approximation, and Sampling Method

Replicated Vector Approximate Message Passing For Resampling Problem

A Monte Carlo Method for Variance Estimation for Estimators Based on Induced Smoothing.

Subsampling for Big Data Linear Models with Measurement Errors

Efficient Learning Via Simulation: A Marginalized Resample-Move Approach

Repro Samples Method for Finite- and Large-Sample Inferences

Stochastic Model Updating Method for Estimates of Arbitrary Distributed Parameters Using Resampling Technique

Regret Bounds and Experimental Design for Estimate-then-Optimize

A Unified Approach to Semiparametric Transformation Models under General Biased Sampling Schemes

Nearly optimal capture-recapture sampling and empirical likelihood weighting estimation for M-estimation with big data

Small Area Quantile Estimation

Noise-Free Sampling Algorithms via Regularized Wasserstein Proximals

Sampling in Latent Space for a Mulitiobjective Estimation of Distribution Algorithm

A Maximin Optimal Approach for Sampling Designs in Two-Phase Studies

Distributed Estimation and Inference for Semi-parametric Binary Response Models