Abstract:The receiver operating characteristic curve is a popular tool to characterize the capabilities of diagnostic tests with continuous or ordinal responses. One common design for assessing the accuracy of diagnostic tests involves multiple readers and multiple tests, in which all readers read all test results from the same patients. This design is most commonly used in a radiology setting, where the results of diagnostic tests depend on a radiologist's subjective interpretation. The most widely used approach for analyzing data from such a study is the Dorfman-Berbaum-Metz (DBM) method (Dorfman et al., 1992) which utilizes a standard analysis of variance (ANOVA) model for the jackknife pseudovalues of the area under the ROC curves (AUCs). Although the DBM method has performed well in published simulation studies, there is no clear theoretical basis for this approach. In this paper, focusing on continuous outcomes, we investigate its theoretical basis. Our result indicates that the DBM method does not satisfy the regular assumptions for standard ANOVA models, and thus might lead to erroneous inference. We then propose a marginal model approach based on the AUCs which can adjust for covariates as well. Consistent and asymptotically normal estimators are derived for regression coefficients. We compare our approach with the DBM method via simulation and by an application to data from a breast cancer study. The simulation results show that both our method and the DBM method perform well when the accuracy of tests under the study is the same and that our method outperforms the DBM method for inference on individual AUCs when the accuracy of tests is not the same. The marginal model approach can be easily extended to ordinal outcomes.

Simultaneous inference for partial areas under receiver operating curves -- with a view towards efficiency

Nonparametric statistical inference method for partial areas under receiver operating characteristic curves, with application to genomic studies.

Semi-Parametric Inference for the Partial Area under the ROC Curve

A non-inferiority test of areas under two parametric ROC curves

ROC Curve Estimation under Test-Result-dependent Sampling.

Joint Statistical Inference for the Area under the ROC Curve and Youden Index under a Density Ratio Model

A Non-Parametric Method for the Comparison of Partial Areas under ROC Curves and Its Application to Large Health Care Data Sets.

Nonparametric ROC Summary Statistics for Correlated Diagnostic Marker Data

Simultaneous Inference in General Parametric Models

Asymptotic properties of the sequential empirical ROC, PPV and NPV curves under case-control sampling

Statistical inference for diagnostic test accuracy studies with multiple comparisons

Nonparametric receiver operating characteristic curve analysis with an imperfect gold standard

Semiparametric Bayesian Approach to Assess Non-Inferiority with Assay Sensitivity in a Three-Arm Trial with Normally Distributed Endpoints

A Marginal Model Approach for Analysis of Multi-Reader Multi-Test Receiver Operating Characteristic (ROC) Data

A test for comparing conditional ROC curves with multidimensional covariates

Robust and flexible inference for the covariate-specific ROC curve

Semiparametric empirical likelihood confidence intervals for the difference of areas under two correlated ROC curves under density ratio model

A comparison of confidence/credible interval methods for the area under the ROC curve for continuous diagnostic tests with small sample size

Interval Estimation for the Difference in Paired Areas under the ROC Curves in the Absence of a Gold Standard Test

A Nonparametric Approach for Partial Areas under ROC Curves and Ordinal Dominance Curves

Nonparametric Covariate Adjustment for Receiver Operating Characteristic Curves