Abstract:Many modern applications require the use of data to both select the statistical tasks and make valid inference after selection. In this article, we provide a unifying approach to control for a class of selective risks. Our method is motivated by a reformulation of the celebrated Benjamini-Hochberg (BH) procedure for multiple hypothesis testing as the iterative limit of the Benjamini-Yekutieli (BY) procedure for constructing post-selection confidence intervals. Although several earlier authors have made noteworthy observations related to this, our discussion highlights that (1) the BH procedure is precisely the fixed-point iteration of the BY procedure; (2) the fact that the BH procedure controls the false discovery rate is almost an immediate corollary of the fact that the BY procedure controls the false coverage-statement rate. Building on this observation, we propose a constructive approach to control extra-selection risk (selection made after decision) by iterating decision strategies that control the post-selection risk (decision made after selection), and show that many previous methods and results are special cases of this general framework. We further extend this approach to problems with multiple selective risks and demonstrate how new methods can be developed. Our development leads to two surprising results about the BH procedure: (1) in the context of one-sided location testing, the BH procedure not only controls the false discovery rate at the null but also at other locations for free; (2) in the context of permutation tests, the BH procedure with exact permutation p-values can be well approximated by a procedure which only requires a total number of permutations that is almost linear in the total number of hypotheses.

Two-Step Method Estimator in Nested Case-Control Studies

Modified Poisson Regression Model for Data of Prospective Studies with Common Outcomes

Nested Case-Control Analysis with General Additive-Multiplicative Hazard Models

A general semiparametric Z-estimation approach for case-cohort studies

Nested case-control sampling without replacement

Gastric banding in the treatment of morbid obesity.

Semiparametric Estimation for the Non-Mixture Cure Model in Case-Cohort and Nested Case-Control Studies

Semiparametric maximum likelihood estimation with two-phase stratified case-control sampling

Quantile Regression Analysis of Case-Cohort Data

Strong Consistence of Estimator for the Change Point in Mean

Structural properties of nondeterministic complete sets

Risk projection for time-to-event outcome from population-based case–control studies leveraging summary statistics from the target population

Robust inference for the proportional hazards model with two-phase cohort sampling data

Estimation of sample sizes in case-control studies with multiple controls per case: dichotomous data

Pooling controls from nested case-control studies with the proportional risks model

Improving estimation efficiency of case-cohort study with interval-censored failure time data

Stochastic comparisons of second-order statistics from dependent and heterogenous modified proportional hazard rate observations

A constructive approach to selective risk control

Two-phase designs with failure time processes subject to nonsusceptibility

Stochastic comparisons of second-order statistics from dependent and heterogeneous modified proportional (reversed) hazard rates scale models

Efficient estimation for left-truncated competing risks regression for case-cohort studies