Abstract:Rapid advancements in data science require us to have fundamentally new frameworks to tackle prevalent but highly non-trivial "irregular" inference problems, to which the large sample central limit theorem does not apply. Typical examples are those involving discrete or non-numerical parameters and those involving non-numerical data, etc. In this article, we present an innovative, wide-reaching, and effective approach, called "repro samples method," to conduct statistical inference for these irregular problems plus more. The development relates to but improves several existing simulation-inspired inference approaches, and we provide both exact and approximate theories to support our development. Moreover, the proposed approach is broadly applicable and subsumes the classical Neyman-Pearson framework as a special case. For the often-seen irregular inference problems that involve both discrete/non-numerical and continuous parameters, we propose an effective three-step procedure to make inferences for all parameters. We also develop a unique matching scheme that turns the discreteness of discrete/non-numerical parameters from an obstacle for forming inferential theories into a beneficial attribute for improving computational efficiency. We demonstrate the effectiveness of the proposed general methodology using various examples, including a case study example on a Gaussian mixture model with unknown number of components. This case study example provides a solution to a long-standing open inference question in statistics on how to quantify the estimation uncertainty for the unknown number of components and other associated parameters. Real data and simulation studies, with comparisons to existing approaches, demonstrate the far superior performance of the proposed method.

Integrating probability and big non-probability samples data to produce Official Statistics

Inference for non-probability samples using the calibration approach for quantiles

Improved Estimation of Population Mean Through Known Conventional and Non-Conventional Measures of Auxiliary Variable

Optimized estimation for population mean using conventional and non-conventional measures under the joint influence of measurement error and non-response

Statistical Inference with Nonignorable Non-Probability Survey Samples

Functional Calibration under Non-Probability Survey Sampling

Bayesian predictive inference when integrating a non-probability sample and a probability sample

Pretest estimation in combining probability and non-probability samples

Adaptive Experiment Design for Probabilistic Integration

Methods for Combining Probability and Nonprobability Samples Under Unknown Overlaps

Efficient Estimation of Nonlinear Finite Population Parameters Using Nonparametrics

Investigating an Alternative for Estimation from a Nonprobability Sample: Matching plus Calibration

Multiple bias-calibration for adjusting selection bias of non-probability samples using data integration

Survey Data Integration for Distribution Function Estimation

Integrating representative and non-representative survey data for efficient inference

Data Integration by combining big data and survey sample data for finite population inference

Data integration of non-probability and probability samples with predictive mean matching

A New Reliability Method Combining Adaptive Kriging and Active Variance Reduction Using Multiple Importance Sampling

Repro Samples Method for a Performance Guaranteed Inference in General and Irregular Inference Problems

Probabilistic Integration: A Role in Statistical Computation?

Non‐parametric inference on calibration of predicted risks