ROCnReg: An R Package for Receiver Operating Characteristic Curve Inference With and Without Covariates

María,Xosé Rodríguez-Álvarez,Vanda Inácio

DOI: https://doi.org/10.32614/rj-2021-066

2021-01-01

The R Journal

Abstract:María Xosé Rodríguez-Álvarez and Vanda Inácio. ROCnReg: An R Package for Receiver Operating Characteristic Curve Inference With and Without Covariates. The R Journal, 13(1):525-555, June 2021.

What problem does this paper attempt to address?

ROCnReg: An R Package for Receiver Operating Characteristic Curve Inference with and without Covariate Information

Maria Xose Rodriguez-Alvarez,Vanda Inacio

DOI: https://doi.org/10.48550/arXiv.2003.13111

2020-03-29

Methodology

Abstract:The receiver operating characteristic (ROC) curve is the most popular tool used to evaluate the discriminatory capability of diagnostic tests/biomarkers measured on a continuous scale when distinguishing between two alternative disease states (e.g, diseased and nondiseased). In some circumstances, the test's performance and its discriminatory ability may vary according to subject-specific characteristics or different test settings. In such cases, information-specific accuracy measures, such as the covariate-specific and the covariate-adjusted ROC curve are needed, as ignoring covariate information may lead to biased or erroneous results. This paper introduces the R package ROCnReg that allows estimating the pooled (unadjusted) ROC curve, the covariate-specific ROC curve, and the covariate-adjusted ROC curve by different methods, both from (semi) parametric and nonparametric perspectives and within Bayesian and frequentist paradigms. From the estimated ROC curve (pooled, covariate-specific or covariate-adjusted), several summary measures of accuracy, such as the (partial) area under the ROC curve and the Youden index, can be obtained. The package also provides functions to obtain ROC-based optimal threshold values using several criteria, namely, the Youden Index criterion and the criterion that sets a target value for the false positive fraction. For the Bayesian methods, we provide tools for assessing model fit via posterior predictive checks, while model choice can be carried out via several information criteria. Numerical and graphical outputs are provided for all methods. The package is illustrated through the analyses of data from an endocrine study where the aim is to assess the capability of the body mass index to detect the presence or absence of cardiovascular disease risk factors. The package is available from CRAN at https://CRAN.R-project.org/package=ROCnReg.
Statistical Inference for Box–Cox based Receiver Operating Characteristic Curves

Leonidas E. Bantis,Benjamin Brewer,Christos T. Nakas,Benjamin Reiser

DOI: https://doi.org/10.1002/sim.10252

2024-11-26

Statistics in Medicine

Abstract:Receiver operating characteristic (ROC) curve analysis is widely used in evaluating the effectiveness of a diagnostic test/biomarker or classifier score. A parametric approach for statistical inference on ROC curves based on a Box–Cox transformation to normality has frequently been discussed in the literature. Many investigators have highlighted the difficulty of taking into account the variability of the estimated transformation parameter when carrying out such an analysis. This variability is often ignored and inferences are made by considering the estimated transformation parameter as fixed and known. In this paper, we will review the literature discussing the use of the Box–Cox transformation for ROC curves and the methodology for accounting for the estimation of the Box–Cox transformation parameter in the context of ROC analysis, and detail its application to a number of problems. We present a general framework for inference on any functional of interest, including common measures such as the AUC, the Youden index, and the sensitivity at a given specificity (and vice versa). We further developed a new R package (named 'rocbc') that carries out all discussed approaches and is available in CRAN.

public, environmental & occupational health,medicine, research & experimental,medical informatics,mathematical & computational biology,statistics & probability
pROC: an open-source package for R and S+ to analyze and compare ROC curves

Xavier Robin,Natacha Turck,Alexandre Hainard,Natalia Tiberti,Frédérique Lisacek,Jean-Charles Sanchez,Markus Müller

DOI: https://doi.org/10.1186/1471-2105-12-77

IF: 3.307

2011-03-17

BMC Bioinformatics

Abstract:BackgroundReceiver operating characteristic (ROC) curves are useful tools to evaluate classifiers in biomedical and bioinformatics applications. However, conclusions are often reached through inconsistent use or insufficient statistical analysis. To support researchers in their ROC curves analysis we developed pROC, a package for R and S+ that contains a set of tools displaying, analyzing, smoothing and comparing ROC curves in a user-friendly, object-oriented and flexible interface.ResultsWith data previously imported into the R or S+ environment, the pROC package builds ROC curves and includes functions for computing confidence intervals, statistical tests for comparing total or partial area under the curve or the operating points of different classifiers, and methods for smoothing ROC curves. Intermediary and final results are visualised in user-friendly interfaces. A case study based on published clinical and biomarker data shows how to perform a typical ROC analysis with pROC.ConclusionspROC is a package for R and S+ specifically dedicated to ROC analysis. It proposes multiple statistical tests to compare ROC curves, and in particular partial areas under the curve, allowing proper ROC interpretation. pROC is available in two versions: in the R programming language or with a graphical user interface in the S+ statistical software. It is accessible at http://expasy.org/tools/pROC/ under the GNU General Public License. It is also distributed through the CRAN and CSAN public repositories, facilitating its installation.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
A test for comparing conditional ROC curves with multidimensional covariates

Arís Fanjul-Hevia,Juan Carlos Pardo-Fernández,Ingrid Van Keilegom,Wenceslao González-Manteiga

DOI: https://doi.org/10.1080/02664763.2022.2116409

2021-02-08

Abstract:The comparison of Receiver Operating Characteristic (ROC) curves is frequently used in the literature to compare the discriminatory capability of different classification procedures based on diagnostic variables. The performance of these variables can be sometimes influenced by the presence of other covariates, and thus they should be taken into account when making the comparison. A new non-parametric test is proposed here for testing the equality of two or more dependent ROC curves conditioned to the value of a multidimensional covariate. Projections are used for transforming the problem into a one-dimensional approach easier to handle. Simulations are carried out to study the practical performance of the new methodology. A real data set of patients with Pleural Effusion is analysed to illustrate this procedure.

Methodology
Nonparametric Covariate Adjustment for Receiver Operating Characteristic Curves

Fang Yao,Radu V. Craiu,Benjamin Reiser

DOI: https://doi.org/10.1002/cjs.10044

2009-01-01

Abstract:The accuracy of a diagnostic test is typically characterised using the receiver operating characteristic (ROC) curve. Summarising indexes such as the area under the ROC curve (AUC) are used to compare different tests as well as to measure the difference between two populations. Often additional information is available on some of the covariates which are known to influence the accuracy of such measures. We propose nonparametric methods for covariate adjustment of the AUC. Models with normal errors and non-normal errors are discussed and analysed separately. Nonparametric regression is used for estimating mean and variance functions in both scenarios. In the general noise case we propose a covariate-adjusted Mann-Whitney estimator for AUC estimation which effectively uses available data to construct working samples at any covariate value of interest and is computationally efficient for implementation. This provides a generalisation of the Mann-Whitney approach for comparing two populations by taking covariate effects into account. We derive asymptotic properties for the AUC estimators in both settings, including asymptotic normality, optimal strong uniform convergence rates and MSE consistency. The usefulness of the proposed methods is demonstrated through simulated and real data examples.
Robust and flexible inference for the covariate-specific ROC curve

Vanda Inacio,Vanda M. Lourenco,Miguel de Carvalho,Richard A. Parker,Vincent Gnanapragasam

DOI: https://doi.org/10.48550/arXiv.2007.06054

2020-07-27

Abstract:Diagnostic tests are of critical importance in health care and medical research. Motivated by the impact that atypical and outlying test outcomes might have on the assessment of the discriminatory ability of a diagnostic test, we develop a flexible and robust model for conducting inference about the covariate-specific receiver operating characteristic (ROC) curve that safeguards against outlying test results while also accommodating for possible nonlinear effects of the covariates. Specifically, we postulate a location-scale additive regression model for the test outcomes in both the diseased and nondiseased populations, combining additive cubic B-splines and M-estimation for the regression function, while the residuals are estimated via a weighted empirical distribution function. The results of the simulation study show that our approach successfully recovers the true covariate-specific ROC curve and corresponding area under the curve on a variety of conceivable test outcomes contamination scenarios. Our method is applied to a dataset derived from a prostate cancer study where we seek to assess the ability of the Prostate Health Index to discriminate between men with and without Gleason 7 or above prostate cancer, and if and how such discriminatory capacity changes with age.

Methodology
PRROC: computing and visualizing precision-recall and receiver operating characteristic curves in R

Jan Grau,Ivo Grosse,Jens Keilwagen

DOI: https://doi.org/10.1093/bioinformatics/btv153

IF: 5.8

2015-03-24

Bioinformatics

Abstract:Precision-recall (PR) and receiver operating characteristic (ROC) curves are valuable measures of classifier performance. Here, we present the R-package PRROC, which allows for computing and visualizing both PR and ROC curves. In contrast to available R-packages, PRROC allows for computing PR and ROC curves and areas under these curves for soft-labeled data using a continuous interpolation between the points of PR curves. In addition, PRROC provides a generic plot function for generating publication-quality graphics of PR and ROC curves.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Confidence Bands for ROC Curves with Serially Dependent Data

Kajal Lahiri,Liu Yang

DOI: https://doi.org/10.1080/07350015.2015.1073593

2015-01-01

Journal of Business and Economic Statistics

Abstract:We propose serial correlation-robust asymptotic confidence bands for the receiver operating characteristic (ROC) curve and its functional, viz., the area under ROC curve (AUC), estimated by quasi-maximum likelihood in the binormal model. Our simulation experiments confirm that this new method performs fairly well in finite samples, and confers an additional measure of robustness to nonnormality. The conventional procedure is found to be markedly undersized in terms of yielding empirical coverage probabilities lower than the nominal level, especially when the serial correlation is strong. An example from macroeconomic forecasting demonstrates the importance of accounting for serial correlation when the probability forecasts for real GDP declines are evaluated using ROC. Supplementary materials for this article are available online.
Neyman-Pearson (NP) classification algorithms and NP receiver operating characteristics (NP-ROC)

Xin Tong,Yang Feng,Jingyi Jessica Li

DOI: https://doi.org/10.1126/sciadv.aao1659

2017-09-28

Abstract:In many binary classification applications such as disease diagnosis and spam detection, practitioners often face great needs to control type I errors (i.e., the conditional probability of misclassifying a class 0 observation as class 1) so that it remains below a desired threshold. To address this need, the Neyman-Pearson (NP) classification paradigm is a natural choice; it minimizes type II error (i.e., the conditional probability of misclassifying a class 1 observation as class 0) while enforcing an upper bound, $\alpha$, on the type I error. Although the NP paradigm has a century-long history in hypothesis testing, it has not been well recognized and implemented in classification schemes. Common practices that directly limit the empirical type I error to no more than $\alpha$ do not satisfy the type I error control objective because the resulting classifiers are still likely to have type I errors much larger than $\alpha$. As a result, the NP paradigm has not been properly implemented for many classification scenarios in practice. In this work, we develop the first umbrella algorithm that implements the NP paradigm for all scoring-type classification methods, including popular methods such as logistic regression, support vector machines and random forests. Powered by this umbrella algorithm, we propose a novel graphical tool for NP classification methods: NP receiver operating characteristic (NP-ROC) bands, motivated by the popular receiver operating characteristic (ROC) curves. NP-ROC bands will help choose $\alpha$ in a data adaptive way and compare different NP classifiers. We demonstrate the use and properties of the NP umbrella algorithm and NP-ROC bands, available in the R package nproc, through simulation and real data case studies.

Methodology
A Novel Regression Method for the Analysis of Multireader Multicase-Free-response Receiver Operating Characteristics Studies.

Xueqing Liu,Jiarui Sun,Xiao-Hua Zhou

DOI: https://doi.org/10.1002/sim.9400

2022-01-01

Statistics in Medicine

Abstract:In diagnostic radiology, the multireader multicase (MRMC) design and the free-response receiver operating characteristics (FROC) method are often used in combination. The cross-correlated data generated by the MRMC-FROC study leads to difficulties in the corresponding analysis, and the need to include covariates in the model further complicates the subsequent analysis. In this paper, we propose a regression approach based on three new measures with good interpretability. The correlation structure of the original test results is taken directly into account in the estimation procedure. The proposed method also allows the inclusion of continuous or discrete covariates. Consistent and asymptotically normal estimators are derived for the new measures. Simulation studies are conducted to evaluate the performance of the proposed approach. The simulation results show that the regression approach performs well under a wide range of scenarios. We also apply the proposed regression approach to a diagnostic study of computer-aided diagnosis in lung cancer.
Nonparametric receiver operating characteristic curve analysis with an imperfect gold standard

Jiarui Sun,Chao Tang,Wuxiang Xie,Xiao-Hua Zhou

DOI: https://doi.org/10.1093/biomtc/ujae063

IF: 1.701

2024-07-01

Biometrics

Abstract:ABSTRACT This article addresses the challenge of estimating receiver operating characteristic (ROC) curves and the areas under these curves (AUC) in the context of an imperfect gold standard, a common issue in diagnostic accuracy studies. We delve into the nonparametric identification and estimation of ROC curves and AUCs when the reference standard for disease status is prone to error. Our approach hinges on the known or estimable accuracy of this imperfect reference standard and the conditional independent assumption, under which we demonstrate the identifiability of ROC curves and propose a nonparametric estimation method. In cases where the accuracy of the imperfect reference standard remains unknown, we establish that while ROC curves are unidentifiable, the sign of the difference between two AUCs is identifiable. This insight leads us to develop a hypothesis-testing method for assessing the relative superiority of AUCs. Compared to the existing methods, the proposed methods are nonparametric so that they do not rely on the parametric model assumptions. In addition, they are applicable to both the ROC/AUC analysis of continuous biomarkers and the AUC analysis of ordinal biomarkers. Our theoretical results and simulation studies validate the proposed methods, which we further illustrate through application in two real-world diagnostic studies.

statistics & probability,mathematical & computational biology,biology
MATLAB toolbox for ROC analysis of multi-reader multi-case diagnostic imaging studies

Brian J. Smith,Stephen L. Hillis

DOI: https://doi.org/10.1117/12.2610663

2022-04-04

Abstract:A common study design for comparing the performances of diagnostic imaging tests is to obtain ratings from multiple readers of multiple cases whose true statuses are known. Typically, there is overlap between the tests, readers, and/or cases for which special analytical methods are needed to perform statistical comparisons. We present our new MATLAB MRMCaov toolbox, which is designed for multi-reader multi-case comparisons of two or more diagnostic tests. The toolbox allows for statistical comparison of reader performance metrics, such as area under the receiver operating characteristic curve (ROC AUC), with analysis of variance methods originally proposed by Obuchowski and Rockette (1995) and later unified and improved by Hillis and colleagues (2005, 2007, 2008, 2018). MRMCaov is open-source software with an integrated command-line interface for performing multi-reader multi-case statistical analysis, plotting, and presenting results. Its features (1) ROC AUC, likelihood ratios of positive or negative ratings, sensitivity, specificity, and expected utility reader performance metrics; (2) reader-specific ROC curves; (3) user-definable performance metrics; (4) test-specific estimates of mean performance along with confidence intervals and p-values for statistical comparisons; (5) support for factorial, nested, or partially paired study designs; (6) inference for random or fixed readers and cases; (7) DeLong, jackknife, or unbiased covariance estimation; and (8) compatibility with Microsoft Windows, Mac OS, and Linux.
Nonparametric statistical inference method for partial areas under receiver operating characteristic curves, with application to genomic studies.

Yaohua He,Michael Escobar

DOI: https://doi.org/10.1002/sim.3335

2008-01-01

Statistics in Medicine

Abstract:Recently ROC50 index-the area under the lower portion of the receiver operating characteristic (ROC) curve up to the first 50 false positives-has been increasingly widely used in genomic research. Unfortunately, statistical inferences on the ROC50 index are not commonly drawn due to a lack of handy statistical inference methods and/or software tools. In this paper, we reviewed developments in statistical methods for the partial areas under ROC curves and using nonparametric methods we derived a simple and direct variance calculation formula for the partial areas, different from existing methods in the literature. We have also verified our method through simulation studies and compared our method with existing bi-normal approaches. We have shown that the partial area has an asymptotic normal distribution using trimmed U-statistics theory. On the basis of this asymptotic normality, we have given formulas for the confidence interval and the test statistic and we reported on their application to a genomic study of sample size approximately 10000. Copyright (C) 2008 John Wiley & Sons, Ltd.
Impact of methodological assumptions and covariates on the cutoff estimation in ROC analysis

Soutik Ghosal

DOI: https://doi.org/10.48550/arXiv.2404.13284

2024-04-20

Abstract:The Receiver Operating Characteristic (ROC) curve stands as a cornerstone in assessing the efficacy of biomarkers for disease diagnosis. Beyond merely evaluating performance, it provides with an optimal cutoff for biomarker values, crucial for disease categorization. While diverse methodologies exist for threshold estimation, less attention has been paid to integrating covariate impact into this process. Covariates can strongly impact diagnostic summaries, leading to variations across different covariate levels. Therefore, a tailored covariate-based framework is imperative for outlining covariate-specific optimal cutoffs. Moreover, recent investigations into cutoff estimators have overlooked the influence of ROC curve estimation methodologies. This study endeavors to bridge this gap by addressing the research void. Extensive simulation studies are conducted to scrutinize the performance of ROC curve estimation models in estimating different cutoffs in varying scenarios, encompassing diverse data-generating mechanisms and covariate effects. Additionally, leveraging the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset, the research assesses the performance of different biomarkers in diagnosing Alzheimer's disease and determines the suitable optimal cutoffs.

Methodology
Matrix variate receiver operating characteristic curve for binary classification

G. Siva,G. SivaDepartment of Mathematics,VIT-AP University,Amaravati,India

DOI: https://doi.org/10.1080/02331888.2024.2320912

IF: 2.346

2024-02-27

Statistics

Abstract:In recent years, the study of Receiver Operating Characteristic (ROC) curve analysis has gained significant attention as a means of accurately assessing test performance and determining optimal cutoff points. Traditionally, ROC models have been developed for bi-distributional univariate and multivariate data, such as Bi-normal, Bi-Exponential, Multivariate ROC models, and so forth. However, in current practical scenarios, the prevalence of high-dimensional matrix variate data poses a challenge for accurate test evaluation. To address this issue, this paper presents a novel ROC model that incorporates matrix variate normal distribution to effectively explain the accuracy of a test in the context of matrix data. Further, the accuracy measure, Area under the Curve (AUC) is derived, which helps in explaining the variability of the curve and provides the sensitivity at a particular value of specificity and vice versa. The proposed methodology is supported by a real data set and simulation studies.

statistics & probability
Decision Making with Machine Learning and ROC Curves

Kai Feng,Han Hong,Ke Tang,Jingyuan Wang

DOI: https://doi.org/10.48550/arXiv.1905.02810

2019-05-05

Methodology

Abstract:The Receiver Operating Characteristic (ROC) curve is a representation of the statistical information discovered in binary classification problems and is a key concept in machine learning and data science. This paper studies the statistical properties of ROC curves and its implication on model selection. We analyze the implications of different models of incentive heterogeneity and information asymmetry on the relation between human decisions and the ROC curves. Our theoretical discussion is illustrated in the context of a large data set of pregnancy outcomes and doctor diagnosis from the Pre-Pregnancy Checkups of reproductive age couples in Henan Province provided by the Chinese Ministry of Health.
A Clustered Optimal ROC Curve Method for Family-Based Genetic Risk Prediction

Chengyin Ye,Jun Zhu,Qing Lu

DOI: https://doi.org/10.4310/sii.2011.v4.n3.a11

2011-01-01

Statistics and Its Interface

Abstract:Risk prediction that capitalizes on emerging genetic findings holds great promises for improving public health and clinical care. Statistical methods for genetic risk prediction research, and particularly for correlated data, are however still lacking. To address this, we have developed a clustered optimal ROC curve (CORC) method, in order to build predictive genetic tests using data from family-based genetic research. For the proposed method, we have extended the conventional optimal ROC curve method to handle multiple genetic markers, taking sample correlation into consideration, and implemented a forward selection algorithm to allow for high-dimensional data and the capture of possible epistasis. We have evaluated the CORC method using both simulations and a real-data application, showing that the method performed better than other existing methods under various pedigree structures and underlying disease models. In the real-data application, we applied the method to the large scale International Multi-Center ADHD Genetics Project dataset and formed a predictive genetic test for conduct disorder. The test reached a low to medium classification accuracy, with an AUC value of 0.6908.
Bayesian Bootstrap Inference for the ROC Surface

Vanda Inacio de Carvalho,Miguel de Carvalho,Adam Branscum

DOI: https://doi.org/10.48550/arXiv.1805.07622

2018-05-20

Abstract:Accurate diagnosis of disease is of great importance in clinical practice and medical research. The receiver operating characteristic (ROC) surface is a popular tool for evaluating the discriminatory ability of continuous diagnostic test outcomes when there exist three ordered disease classes (e.g., no disease, mild disease, advanced disease). We propose the Bayesian bootstrap, a fully nonparametric method, for conducting inference about the ROC surface and its functionals, such as the volume under the surface. The proposed method is based on a simple, yet interesting, representation of the ROC surface in terms of placement variables. Results from a simulation study demonstrate the ability of our method to successfully recover the true ROC surface and to produce valid inferences in a variety of complex scenarios. An application to data from the Trail Making Test to assess cognitive impairment in Parkinson's disease patients is provided.

Methodology
Netreg: Network-Regularized Linear Models for Biological Association Studies

Simon Dirmeier,Christiane Fuchs,Nikola S. Mueller,Fabian J. Theis

DOI: https://doi.org/10.1093/bioinformatics/btx677

IF: 5.8

2017-01-01

Bioinformatics

Abstract:Modelling biological associations or dependencies using linear regression is often complicated when the analyzed data-sets are high-dimensional and less observations than variables are availableling this issue. Recently proposed regression models utilize prior knowledge on dependencies, e.g. in the form of graphs, arguing that this information will lead to more reliable estimates for regression coefficients. However, none of the proposed models for multivariate genomic response variables have been implemented as a computationally efficient, freely available library. In this paper we propose netReg, a package for graph-penalized regression models that use large networks and thousands of variables. netReg incorporates a priori generated biological graph information into linear models yielding sparse or smooth solutions for regression coefficients. netReg is implemented as both R-package and C ++ commandline tool. The main computations are done in C ++, where we use Armadillo for fast matrix calculations and Dlib for optimization. The R package is freely available on https://bioconductor.org/packages/netReg. The command line tool can be installed using the conda channel Bioconda. Installation details, issue reports, development versions, documentation and tutorials for the R and C ++ versions and the R package vignette can be found on GitHub ext-link-type="https://dirmeier.github.io/netReg/. The GitHub page also contains code for benchmarking and example datasets used in this paper.
A DIRECT SEMIPARAMETRIC RECEIVER OPERATING CHARACTERISTIC CURVE REGRESSION WITH UNKNOWN LINK AND BASELINE FUNCTIONS.

Huazhen Lin,Xiao-Hua Zhou,Gang Li

DOI: https://doi.org/10.5705/ss.2010.167

IF: 1.4

2011-01-01

Statistica Sinica

Abstract:In this article, we study a direct receiver operating characteristic (ROC) curve regression model with completely unknown link and baseline functions. A semiparametric procedure is proposed to estimate both the parametric and non-parametric components of the model. The resulting parameter estimates and ROC curve estimates are shown to be consistent and asymptotically normal with a n -1/2 convergence rate. With arbitrary link and baseline functions, our model is more robust than existing direct ROC regression models that require either complete or partially complete specification of the link and baseline functions. Moreover, the robustness of our new method is gained at little cost to efficiency, as evidenced by the parametric convergence rate of our estimators and by the simulation study. An illustrative example is given using a hearing test data set.

ROCnReg: An R Package for Receiver Operating Characteristic Curve Inference With and Without Covariates

ROCnReg: An R Package for Receiver Operating Characteristic Curve Inference with and without Covariate Information

Statistical Inference for Box–Cox based Receiver Operating Characteristic Curves

pROC: an open-source package for R and S+ to analyze and compare ROC curves

A test for comparing conditional ROC curves with multidimensional covariates

Nonparametric Covariate Adjustment for Receiver Operating Characteristic Curves

Robust and flexible inference for the covariate-specific ROC curve

PRROC: computing and visualizing precision-recall and receiver operating characteristic curves in R

Confidence Bands for ROC Curves with Serially Dependent Data

Neyman-Pearson (NP) classification algorithms and NP receiver operating characteristics (NP-ROC)

A Novel Regression Method for the Analysis of Multireader Multicase-Free-response Receiver Operating Characteristics Studies.

Nonparametric receiver operating characteristic curve analysis with an imperfect gold standard

MATLAB toolbox for ROC analysis of multi-reader multi-case diagnostic imaging studies

Nonparametric statistical inference method for partial areas under receiver operating characteristic curves, with application to genomic studies.

Impact of methodological assumptions and covariates on the cutoff estimation in ROC analysis

Matrix variate receiver operating characteristic curve for binary classification

Decision Making with Machine Learning and ROC Curves

A Clustered Optimal ROC Curve Method for Family-Based Genetic Risk Prediction

Bayesian Bootstrap Inference for the ROC Surface

Netreg: Network-Regularized Linear Models for Biological Association Studies

A DIRECT SEMIPARAMETRIC RECEIVER OPERATING CHARACTERISTIC CURVE REGRESSION WITH UNKNOWN LINK AND BASELINE FUNCTIONS.