Abstract:Abstract Background and objectives: Motivated from a study on breast cancer, we consider the problem of evaluating a statistical hypothesis when some model characteristics are potentially non or weakly identifiable from observed data. Such scenarios are common in longitudinal studies for evaluating a covariate effect when dropouts may be informative. The hypothesis related to treatment effects may not be testable nonparametrically, with untestable model restrictions necessary for inference. A popular approach is to assume a finite dimensional model and to fix a minimal set of parameters, called sensitivity parameters, conditional upon which hypothesized parameters are assumed identifiable. These profile models, viewed as a functional of the secondary or sensitivity parameters, form the basis of sensitivity analysis. In the current literature, however, inference regarding significance of the covariates is ad hoc, ignoring that multiple tests are conducted and that the working model may be misspecified. Methods and results: In this paper, we propose conservatively testing the null hypothesis of interest across the support of the sensitivity parameters using an infimum test statistic. The test must account for the facts that inferences are carried out simultaneously across the entire range of the sensitivity parameters and that the model may be misspecified under certain values of the sensitivity parameters, as might occur if a nonignorable model is fit, when, in reality, missingness is ignorable. We characterize the limiting distribution of the statistic as a functional of processes in the sensitivity parameters, which involves a careful theoretical analysis of its behavior under model misspecification. In practice, we suggest a simple yet flexible resampling procedure to implement the infimum test as well as to construct confidence bands for simultaneous pointwise tests across all values of the sensitivity parameters. The methodology's practical utility is illustrated in simulations and an analysis of quality-of-life outcomes from a longitudinal study on breast cancer. Interestingly in this example, a covariate effect on cancer outcomes is detected over a wide range of the sensitivity parameter when a Wald test that assumes identifiability fails. Implications and next steps: The key implication of this work is that the hypothesis of interest can be conservatively evaluated across the support of the sensitivity parameters using an infimum test statistic over the space of these parameters. A key assumption of this paper is that the working model is finite dimensional although the full specification of distribution of the data is not required. The methodology should be broadly applicable to infinite dimensional models, such as survival models for censored data. This extension is the focus of current research work. Citation Information: Cancer Epidemiol Biomarkers Prev 2011;20(10 Suppl):A6.

Hypothesis testing for detecting outlier evaluators

Hypothesis Testing for Detecting Outlier Evaluators

Analytical method for detecting outlier evaluators

Outcome measurement error correction for survival analyses with multiple failure types: application to hearing loss studies

Sensitivity analysis with iterative outlier detection for systematic reviews and meta‐analyses

Hypothesis Tests for Continuous Audiometric Threshold Data

Asymptotics for Outlier Hypothesis Testing

A Shrinkage Method for Testing the Hardy–Weinberg Equilibrium in Case‐Control Studies

Abstract A6: A Global Sensitivity Test for Evaluating Hypotheses with Non- and Weakly Identifiable Statistical Models: an Application to Breast Cancer Outcomes

Comparison of Different Response Time Outlier Exclusion Methods: A Simulation Study

Exponentially Consistent Outlier Hypothesis Testing for Continuous Sequences

Universal Sequential Outlier Hypothesis Testing

Comparisons of methods for multiple hypothesis testing in neuropsychological research.

A method for outlier detection based on cluster analysis and visual expert criteria

Sequential Outlier Hypothesis Testing under Universality Constraints

Optimal two-phase sampling for comparing correlated areas under the ROC curves of two screening tests in the presence of verification bias

Test of Significance for High-dimensional Thresholds with Application to Individualized Minimal Clinically Important Difference

Asymptotically Pivotal Statistic for Surrogate Testing with Extended Hypothesis

Multi-species numerical validation of an efficient algorithm for auditory brainstem response hearing threshold estimation

A New Outlier Detection Method Considering Outliers As Model Errors

Detection of outlying patterns from sparse and irregularly sampled electronic health records data