Abstract:BackgroundROC (receiver operating characteristic) curve analysis is well established for assessing how well a marker is capable of discriminating between individuals who experience disease onset and individuals who do not. The classical (standard) approach of ROC curve analysis considers event (disease) status and marker value for an individual as fixed over time, however in practice, both the disease status and marker value change over time. Individuals who are disease-free earlier may develop the disease later due to longer study follow-up, and also their marker value may change from baseline during follow-up. Thus, an ROC curve as a function of time is more appropriate. However, many researchers still use the standard ROC curve approach to determine the marker capability ignoring the time dependency of the disease status or the marker.MethodsWe comprehensively review currently proposed methodologies of time-dependent ROC curves which use single or longitudinal marker measurements, aiming to provide clarity in each methodology, identify software tools to carry out such analysis in practice and illustrate several applications of the methodology. We have also extended some methods to incorporate a longitudinal marker and illustrated the methodologies using a sequential dataset from the Mayo Clinic trial in primary biliary cirrhosis (PBC) of the liver.ResultsFrom our methodological review, we have identified 18 estimation methods of time-dependent ROC curve analyses for censored event times and three other methods can only deal with non-censored event times. Despite the considerable numbers of estimation methods, applications of the methodology in clinical studies are still lacking.ConclusionsThe value of time-dependent ROC curve methods has been re-established. We have illustrated the methods in practice using currently available software and made some recommendations for future research.

Comparison of Diagnostic Markers with Repeated Measurements: a Non-Parametric ROC Curve Approach.

Nonparametric ROC Summary Statistics for Correlated Diagnostic Marker Data

A Non-Parametric Method for the Comparison of Partial Areas under ROC Curves and Its Application to Large Health Care Data Sets.

Nonparametric receiver operating characteristic curve analysis with an imperfect gold standard

A comparison of confidence/credible interval methods for the area under the ROC curve for continuous diagnostic tests with small sample size

A Dunnett-Type Test and Its Sample Size Calculation for Comparing K ROC Curves with a Control

Time-dependent ROC curve analysis in medical research: current methods and applications

Different view of the diagnostics test accuracy measures and optimal cut-off point selection procedure under tree or umbrella ordering

Statistical Methods for Comparing Predictive Values in Medical Diagnosis

Logistic regression analysis with standardized markers

A discrete time-to-event model for the meta-analysis of full ROC curves

Between a ROC and a Hard Place: Using prevalence plots to understand the likely real world performance of biomarkers in the clinic

Interval Estimation for the Difference in Paired Areas under the ROC Curves in the Absence of a Gold Standard Test

A test for comparing conditional ROC curves with multidimensional covariates

Semiparametric empirical likelihood confidence intervals for the difference of areas under two correlated ROC curves under density ratio model

Statistical inference for diagnostic test accuracy studies with multiple comparisons

Asymptotic properties of the sequential empirical ROC, PPV and NPV curves under case-control sampling

Simultaneous inference for partial areas under receiver operating curves -- with a view towards efficiency

Homogeneity Tests of Clustered Diagnostic Markers with Applications to the BioCycle Study.

ROC curve analysis: a useful statistic multi-tool in the research of nephrology

Transformed ROC Curve for Biomarker Evaluation