Abstract:Recent likelihood theory produces $p$-values that have remarkable accuracy and wide applicability. The calculations use familiar tools such as maximum likelihood values (MLEs), observed information and parameter rescaling. The usual evaluation of such $p$-values is by simulations, and such simulations do verify that the global distribution of the $p$-values is uniform(0, 1), to high accuracy in repeated sampling. The derivation of the $p$-values, however, asserts a stronger statement, that they have a uniform(0, 1) distribution conditionally, given identified precision information provided by the data. We take a simple regression example that involves exact precision information and use large sample techniques to extract highly accurate information as to the statistical position of the data point with respect to the parameter: specifically, we examine various $p$-values and Bayesian posterior survivor $s$-values for validity. With observed data we numerically evaluate the various $p$-values and $s$-values, and we also record the related general formulas. We then assess the numerical values for accuracy using Markov chain Monte Carlo (McMC) methods. We also propose some third-order likelihood-based procedures for obtaining means and variances of Bayesian posterior distributions, again followed by McMC assessment. Finally we propose some adaptive McMC methods to improve the simulation acceptance rates. All these methods are based on asymptotic analysis that derives from the effect of additional data. And the methods use simple calculations based on familiar maximizing values and related informations. The example illustrates the general formulas and the ease of calculations, while the McMC assessments demonstrate the numerical validity of the $p$-values as percentage position of a data point. The example, however, is very simple and transparent, and thus gives little indication that in a wide generality of models the formulas do accurately separate information for almost any parameter of interest, and then do give accurate $p$-value determinations from that information. As illustration an enigmatic problem in the literature is discussed and simulations are recorded; various examples in the literature are cited.

Efficiently Simulating the Coverage Properties of Interval Estimates

Importance Sampling of Interval Markov Chains

Multiple Imputation for Interval Estimation from Simple Random Samples with Ignorable Nonresponse

Matching Bayesian and frequentist coverage probabilities when using an approximate data covariance matrix

Stratified sampling and bootstrapping for approximate Bayesian computation

Interval estimation of the overlapping coefficients in an exponential family of distributions based on upper record values

Bayesian Uncertainty Estimation Under Complex Sampling

A simulation study to compare methods for constructing confidence intervals for the incremental cost-effectiveness ratio

Bayesian nonparametric estimation of coverage probabilities and distinct counts from sketched data

Estimating the Sampling Distribution of Posterior Decision Summaries in Bayesian Clinical Trials

Efficient Importance Sampling for Rare Event Simulation with Applications

Interval Estimation for the Two-Parameter Exponential Distribution Based on Upper Record Value Data Using Bayesian Approaches

Predictive Probabilities Made Simple: A Fast and Accurate Method for Clinical Trial Decision Making

Modified Clopper-Pearson Confidence Interval for Binomial Proportion

Confidence Intervals for Nonparametric Empirical Bayes Analysis

Assessing the coverage probabilities of fixed-margin confidence intervals for the tail conditional allocation

Higher Accuracy for Bayesian and Frequentist Inference: Large Sample Theory for Small Sample Likelihood

Asymptotic infimum coverage probability for interval estimation of proportions

Assessing the properties of the prediction interval in random-effects meta-analysis

Uncertainty Quantification and Confidence Intervals for Naive Rare-Event Estimators

Rank conditional coverage and confidence intervals in high dimensional problems