Abstract:Abstract Background and objectives: Motivated from a study on breast cancer, we consider the problem of evaluating a statistical hypothesis when some model characteristics are potentially non or weakly identifiable from observed data. Such scenarios are common in longitudinal studies for evaluating a covariate effect when dropouts may be informative. The hypothesis related to treatment effects may not be testable nonparametrically, with untestable model restrictions necessary for inference. A popular approach is to assume a finite dimensional model and to fix a minimal set of parameters, called sensitivity parameters, conditional upon which hypothesized parameters are assumed identifiable. These profile models, viewed as a functional of the secondary or sensitivity parameters, form the basis of sensitivity analysis. In the current literature, however, inference regarding significance of the covariates is ad hoc, ignoring that multiple tests are conducted and that the working model may be misspecified. Methods and results: In this paper, we propose conservatively testing the null hypothesis of interest across the support of the sensitivity parameters using an infimum test statistic. The test must account for the facts that inferences are carried out simultaneously across the entire range of the sensitivity parameters and that the model may be misspecified under certain values of the sensitivity parameters, as might occur if a nonignorable model is fit, when, in reality, missingness is ignorable. We characterize the limiting distribution of the statistic as a functional of processes in the sensitivity parameters, which involves a careful theoretical analysis of its behavior under model misspecification. In practice, we suggest a simple yet flexible resampling procedure to implement the infimum test as well as to construct confidence bands for simultaneous pointwise tests across all values of the sensitivity parameters. The methodology's practical utility is illustrated in simulations and an analysis of quality-of-life outcomes from a longitudinal study on breast cancer. Interestingly in this example, a covariate effect on cancer outcomes is detected over a wide range of the sensitivity parameter when a Wald test that assumes identifiability fails. Implications and next steps: The key implication of this work is that the hypothesis of interest can be conservatively evaluated across the support of the sensitivity parameters using an infimum test statistic over the space of these parameters. A key assumption of this paper is that the working model is finite dimensional although the full specification of distribution of the data is not required. The methodology should be broadly applicable to infinite dimensional models, such as survival models for censored data. This extension is the focus of current research work. Citation Information: Cancer Epidemiol Biomarkers Prev 2011;20(10 Suppl):A6.

Welch's t test is more sensitive to real world violations of distributional assumptions than student's t test but logistic regression is more robust than either

Another Argument in Favour of Wilcoxon's Signed Rank Test

Blindly using Wald's test can miss rare disease-causal variants in case-control association studies.

A Shrinkage Method for Testing the Hardy–Weinberg Equilibrium in Case‐Control Studies

Inferential procedures based on the weighted Pearson correlation coefficient test statistic

A stepwise likelihood ratio test procedure for rare variant selection in case–control studies

t-tests, non-parametric tests, and large studies—a paradox of statistical practice?

The New and Improved Two-Sample t Test

The Shrinkage Variance Hotelling $T^2$ Test for Genomic Profiling Studies

The two-sample t test: pre-testing its assumptions does not pay off

Powerful t-tests in the presence of nonclassical measurement error

Case for omitting tied observations in the two-sample t-test and the Wilcoxon-Mann-Whitney Test

Comparison of Test Statistics of Nonnormal and Unbalanced Samples for Multivariate Analysis of Variance in terms of Type-I Error Rates

Model-free selective inference under covariate shift via weighted conformal p-values

An efficient asymptotic approach for testing monotone proportions assuming an underlying logit based order dose-response model

An unconditional exact test for the Hardy-Weinberg equilibrium law: sample-space ordering using the Bayes factor.

Detecting rare and weak deviations of non-proportional hazard in survival analysis

Random-effect Based Test for Multinomial Logistic Regression: Choice of the Reference Level and Its Impact on the Testing

Incorporation of Sparsity Information in Large-scale Multiple Two-sample $t$ Tests

Abstract A6: A Global Sensitivity Test for Evaluating Hypotheses with Non- and Weakly Identifiable Statistical Models: an Application to Breast Cancer Outcomes

A two-sample Bayesian t-test for microarray data