Abstract:Abstract Background and objectives: Motivated from a study on breast cancer, we consider the problem of evaluating a statistical hypothesis when some model characteristics are potentially non or weakly identifiable from observed data. Such scenarios are common in longitudinal studies for evaluating a covariate effect when dropouts may be informative. The hypothesis related to treatment effects may not be testable nonparametrically, with untestable model restrictions necessary for inference. A popular approach is to assume a finite dimensional model and to fix a minimal set of parameters, called sensitivity parameters, conditional upon which hypothesized parameters are assumed identifiable. These profile models, viewed as a functional of the secondary or sensitivity parameters, form the basis of sensitivity analysis. In the current literature, however, inference regarding significance of the covariates is ad hoc, ignoring that multiple tests are conducted and that the working model may be misspecified. Methods and results: In this paper, we propose conservatively testing the null hypothesis of interest across the support of the sensitivity parameters using an infimum test statistic. The test must account for the facts that inferences are carried out simultaneously across the entire range of the sensitivity parameters and that the model may be misspecified under certain values of the sensitivity parameters, as might occur if a nonignorable model is fit, when, in reality, missingness is ignorable. We characterize the limiting distribution of the statistic as a functional of processes in the sensitivity parameters, which involves a careful theoretical analysis of its behavior under model misspecification. In practice, we suggest a simple yet flexible resampling procedure to implement the infimum test as well as to construct confidence bands for simultaneous pointwise tests across all values of the sensitivity parameters. The methodology's practical utility is illustrated in simulations and an analysis of quality-of-life outcomes from a longitudinal study on breast cancer. Interestingly in this example, a covariate effect on cancer outcomes is detected over a wide range of the sensitivity parameter when a Wald test that assumes identifiability fails. Implications and next steps: The key implication of this work is that the hypothesis of interest can be conservatively evaluated across the support of the sensitivity parameters using an infimum test statistic over the space of these parameters. A key assumption of this paper is that the working model is finite dimensional although the full specification of distribution of the data is not required. The methodology should be broadly applicable to infinite dimensional models, such as survival models for censored data. This extension is the focus of current research work. Citation Information: Cancer Epidemiol Biomarkers Prev 2011;20(10 Suppl):A6.

Nonparametric Sample Size Estimation for Sensitivity and Specificity with Multiple Observations per Subject

Sample size estimation in diagnostic test studies of biomedical informatics

Statistical inference for diagnostic test accuracy studies with multiple comparisons

Revisiting sample size planning for receiver operating characteristic studies: A confidence interval approach with precision and assurance

A Dunnett-Type Test and Its Sample Size Calculation for Comparing K ROC Curves with a Control

Comparing the predictive values of diagnostic tests: sample size and analysis for paired study designs

Practical Sample Size Calculations for Surveillance and Diagnostic Investigations

Abstract A6: A Global Sensitivity Test for Evaluating Hypotheses with Non- and Weakly Identifiable Statistical Models: an Application to Breast Cancer Outcomes

Simultaneous inference for partial areas under receiver operating curves -- with a view towards efficiency

A Non-Parametric Method for the Comparison of Partial Areas under ROC Curves and Its Application to Large Health Care Data Sets.

Sample size determination for semiparametric analysis of current status data

Hybrid Design Evaluating New Biomarkers when There is an Existing Screening Test

Sample size determination for interval estimation of the prevalence of a sensitive attribute under non‐randomized response models

A comparison of confidence/credible interval methods for the area under the ROC curve for continuous diagnostic tests with small sample size

Adaptive sample size determination for the development of clinical prediction models

Sample size determination for point-of-care COVID-19 diagnostic tests: a Bayesian approach

Sample size determination based on rank tests in clinical trials.

Comparison of Diagnostic Markers with Repeated Measurements: a Non-Parametric ROC Curve Approach.

A multiple testing framework for diagnostic accuracy studies with co-primary endpoints

A likelihood based sensitivity analysis for publication bias on summary ROC in meta-analysis of diagnostic test accuracy

Nonparametric ROC Summary Statistics for Correlated Diagnostic Marker Data