Abstract:Abstract Background and objectives: Motivated from a study on breast cancer, we consider the problem of evaluating a statistical hypothesis when some model characteristics are potentially non or weakly identifiable from observed data. Such scenarios are common in longitudinal studies for evaluating a covariate effect when dropouts may be informative. The hypothesis related to treatment effects may not be testable nonparametrically, with untestable model restrictions necessary for inference. A popular approach is to assume a finite dimensional model and to fix a minimal set of parameters, called sensitivity parameters, conditional upon which hypothesized parameters are assumed identifiable. These profile models, viewed as a functional of the secondary or sensitivity parameters, form the basis of sensitivity analysis. In the current literature, however, inference regarding significance of the covariates is ad hoc, ignoring that multiple tests are conducted and that the working model may be misspecified. Methods and results: In this paper, we propose conservatively testing the null hypothesis of interest across the support of the sensitivity parameters using an infimum test statistic. The test must account for the facts that inferences are carried out simultaneously across the entire range of the sensitivity parameters and that the model may be misspecified under certain values of the sensitivity parameters, as might occur if a nonignorable model is fit, when, in reality, missingness is ignorable. We characterize the limiting distribution of the statistic as a functional of processes in the sensitivity parameters, which involves a careful theoretical analysis of its behavior under model misspecification. In practice, we suggest a simple yet flexible resampling procedure to implement the infimum test as well as to construct confidence bands for simultaneous pointwise tests across all values of the sensitivity parameters. The methodology's practical utility is illustrated in simulations and an analysis of quality-of-life outcomes from a longitudinal study on breast cancer. Interestingly in this example, a covariate effect on cancer outcomes is detected over a wide range of the sensitivity parameter when a Wald test that assumes identifiability fails. Implications and next steps: The key implication of this work is that the hypothesis of interest can be conservatively evaluated across the support of the sensitivity parameters using an infimum test statistic over the space of these parameters. A key assumption of this paper is that the working model is finite dimensional although the full specification of distribution of the data is not required. The methodology should be broadly applicable to infinite dimensional models, such as survival models for censored data. This extension is the focus of current research work. Citation Information: Cancer Epidemiol Biomarkers Prev 2011;20(10 Suppl):A6.

How can the score test be consistent?

Generalized score test of homogeneity for mixed effects models

Consistent Specification Testing Via Nonparametric Series Regression

Testing the Consistency of Performance Scores Reported for Binary Classification Problems

Large Deviation Analysis of Score-Based Hypothesis Testing

Simple solution to a common statistical problem: Interpreting multiple tests

An efficient asymptotic approach for testing monotone proportions assuming an underlying logit based order dose-response model

Using score distributions to compare statistical significance tests for information retrieval evaluation

Higher-Order Asymptotics and Its Application to Testing the Equality of the Examinee Ability Over Two Sets of Items

Hypothesis Test to Compare Two Paired Binomial Proportions: Assessment of 24 Methods

Sequential-Analysis for Censored Regression Data

A robust Spearman correlation coefficient permutation test

Small-sample corrections for score tests in Birnbaum-Saunders regressions

Miettinen and Nurminen score statistics revisited

Robust likelihood ratio tests for composite nulls and alternatives

Relative likelihood ratios for neutral comparisons of statistical tests in simulation studies

On consistency and inconsistency of nonparametric tests

Another Argument in Favour of Wilcoxon's Signed Rank Test

An improved sample size calculation method for score tests in generalized linear models

Abstract A6: A Global Sensitivity Test for Evaluating Hypotheses with Non- and Weakly Identifiable Statistical Models: an Application to Breast Cancer Outcomes