Abstract:This article presents a novel, general, and effective simulation-inspired approach, called {\it repro samples method}, to conduct statistical inference. The approach studies the performance of artificial samples, referred to as {\it repro samples}, obtained by mimicking the true observed sample to achieve uncertainty quantification and construct confidence sets for parameters of interest with guaranteed coverage rates. Both exact and asymptotic inferences are developed. An attractive feature of the general framework developed is that it does not rely on the large sample central limit theorem and is likelihood-free. As such, it is thus effective for complicated inference problems which we can not solve using the large sample central limit theorem. The proposed method is applicable to a wide range of problems, including many open questions where solutions were previously unavailable, for example, those involving discrete or non-numerical parameters. To reduce the large computational cost of such inference problems, we develop a unique matching scheme to obtain a data-driven candidate set. Moreover, we show the advantages of the proposed framework over the classical Neyman-Pearson framework. We demonstrate the effectiveness of the proposed approach on various models throughout the paper and provide a case study that addresses an open inference question on how to quantify the uncertainty for the unknown number of components in a normal mixture model. To evaluate the empirical performance of our repro samples method, we conduct simulations and study real data examples with comparisons to existing approaches. Although the development pertains to the settings where the large sample central limit theorem does not apply, it also has direct extensions to the cases where the central limit theorem does hold.

A Mathematically Sensible Explanation of the Concept of Statistical Population

Improved Estimation of Population Mean Through Known Conventional and Non-Conventional Measures of Auxiliary Variable

Enhanced Estimation of Population Mean in the Presence of Auxiliary Information

A Geometric Approach to Finite Population Sampling

On Estimation of Finite Population Proportion

An Analysis Of Estimation Of Distribution Algorithms With Finite Population Models

Statistics students' identification of inferential model elements within contexts of their own invention

Introduction to probability and statistics: a computational framework of randomness

Development of high school students' conceptions of sampling distribution in the context of learning significance tests with technology

Methods of population study in a biology course at school

The Spatial Statistic Trinity: A Generic Framework for Spatial Sampling and Inference.

Probability Sampling Designs: Principles for Choice of Design and Balancing

Statistics without Interpretation: A Sober Look at Explainable Machine Learning

Six Statistical Senses

Survey on data science with population-based algorithms

Which distribution were you sampled from? Towards a more tangible conception of data

Repro Samples Method for Finite- and Large-Sample Inferences

Bayes, Neyman, and Calibration

Its All on the Square- The Importance of the Sum of Squares and Making the General Linear Model Simple

Connecting Simple and Precise P-values to Complex and Ambiguous Realities

Solving the Random Pielou Logistic Equation with the Random Variable Transformation Technique: Theory and Applications