Abstract:Rapid advancements in data science require us to have fundamentally new frameworks to tackle prevalent but highly non-trivial "irregular" inference problems, to which the large sample central limit theorem does not apply. Typical examples are those involving discrete or non-numerical parameters and those involving non-numerical data, etc. In this article, we present an innovative, wide-reaching, and effective approach, called "repro samples method," to conduct statistical inference for these irregular problems plus more. The development relates to but improves several existing simulation-inspired inference approaches, and we provide both exact and approximate theories to support our development. Moreover, the proposed approach is broadly applicable and subsumes the classical Neyman-Pearson framework as a special case. For the often-seen irregular inference problems that involve both discrete/non-numerical and continuous parameters, we propose an effective three-step procedure to make inferences for all parameters. We also develop a unique matching scheme that turns the discreteness of discrete/non-numerical parameters from an obstacle for forming inferential theories into a beneficial attribute for improving computational efficiency. We demonstrate the effectiveness of the proposed general methodology using various examples, including a case study example on a Gaussian mixture model with unknown number of components. This case study example provides a solution to a long-standing open inference question in statistics on how to quantify the estimation uncertainty for the unknown number of components and other associated parameters. Real data and simulation studies, with comparisons to existing approaches, demonstrate the far superior performance of the proposed method.

Inferences on the common mean of several inverse Gaussian populations

Inferences on the difference and ratio of the means of two inverse Gaussian distributions

Simultaneous Confidence Intervals for Several Inverse Gaussian Populations

Inference on order restricted means of inverse Gaussian populations under heteroscedasticity

A comparison of various estimators of the mean of an inverse gaussian distribution

Likelihood Based Inference for the Shape Parameter of the Inverse Gaussian Distribution

Estimating the Confidence Interval for the Common Coefficient of Variation for Multiple Inverse Gaussian Distributions

Purely Sequential and k-Stage Procedures for Estimating the Mean of an Inverse Gaussian Distribution

The Gaussian approximation for multi-color generalized Friedman’s urn model

Wald Intervals via Profile Likelihood for the Mean of the Inverse Gaussian Distribution

Maximum likelihood estimation of the parameters of the inverse Gaussian distribution using maximum rank set sampling with unequal samples

An adaptive Gaussian process method for multi-modal Bayesian inverse problems

Hypothesis Testing in Gaussian Graphical Models: Novel Goodness-of-Fit Tests and Conditional Randomization Tests

Robust inference for the unification of confidence intervals in meta-analysis

Shrinkage Testimator for the Common Mean of Several Univariate Normal Populations

STATISTICAL INFERENCE BASED ON THE LENGTH-BIASED DATA FOR THE INVERSE GAUSSIAN DISTRIBUTION

Generalized inverse transformation method via representative points in statistical simulation

Testing the equality of multivariate means when $p>n$ by combining the Hoteling and Simes tests

Repro Samples Method for a Performance Guaranteed Inference in General and Irregular Inference Problems