Abstract:BackgroundROC (receiver operating characteristic) curve analysis is well established for assessing how well a marker is capable of discriminating between individuals who experience disease onset and individuals who do not. The classical (standard) approach of ROC curve analysis considers event (disease) status and marker value for an individual as fixed over time, however in practice, both the disease status and marker value change over time. Individuals who are disease-free earlier may develop the disease later due to longer study follow-up, and also their marker value may change from baseline during follow-up. Thus, an ROC curve as a function of time is more appropriate. However, many researchers still use the standard ROC curve approach to determine the marker capability ignoring the time dependency of the disease status or the marker.MethodsWe comprehensively review currently proposed methodologies of time-dependent ROC curves which use single or longitudinal marker measurements, aiming to provide clarity in each methodology, identify software tools to carry out such analysis in practice and illustrate several applications of the methodology. We have also extended some methods to incorporate a longitudinal marker and illustrated the methodologies using a sequential dataset from the Mayo Clinic trial in primary biliary cirrhosis (PBC) of the liver.ResultsFrom our methodological review, we have identified 18 estimation methods of time-dependent ROC curve analyses for censored event times and three other methods can only deal with non-censored event times. Despite the considerable numbers of estimation methods, applications of the methodology in clinical studies are still lacking.ConclusionsThe value of time-dependent ROC curve methods has been re-established. We have illustrated the methods in practice using currently available software and made some recommendations for future research.

Methods of determining optimal cut-point of diagnostic biomarkers with application of clinical data in ROC analysis: an update review

Defining an Optimal Cut-Point Value in ROC Analysis: An Alternative Approach

Time-dependent ROC curve analysis in medical research: current methods and applications

Impact of methodological assumptions and covariates on the cutoff estimation in ROC analysis

Computation and Selection of Optimal Biomarker Combinations by Integrative ROC Analysis Using CombiROC

ROC curve analysis: a useful statistic multi-tool in the research of nephrology

Comparison of Diagnostic Markers with Repeated Measurements: a Non-Parametric ROC Curve Approach.

Different view of the diagnostics test accuracy measures and optimal cut-off point selection procedure under tree or umbrella ordering

Nonparametric ROC Summary Statistics for Correlated Diagnostic Marker Data

Receiver operating characteristic curve: overview and practical use for clinicians

Transformed ROC Curve for Biomarker Evaluation

Biostatistics in clinical decision making for cardiothoracic radiologists

A discrete time-to-event model for the meta-analysis of full ROC curves

Optimal Cut-Point Estimation for functional digital biomarkers: Application to Continuous Glucose Monitoring

Between a ROC and a Hard Place: Using prevalence plots to understand the likely real world performance of biomarkers in the clinic

Understanding decision curve analysis in clinical prediction model research

A placement-value based approach to concave ROC analysis

What is an ROC curve?

A Non-Parametric Method for the Comparison of Partial Areas under ROC Curves and Its Application to Large Health Care Data Sets.

Meta‐Analysis of Diagnostic Accuracy Studies With Multiple Thresholds: Comparison of Approaches in a Simulation Study

Logistic regression analysis with standardized markers