Confidence Bands for ROC Curves with Serially Dependent Data

Kajal Lahiri,Liu Yang
DOI: https://doi.org/10.1080/07350015.2015.1073593
2015-01-01
Journal of Business and Economic Statistics
Abstract:We propose serial correlation-robust asymptotic confidence bands for the receiver operating characteristic (ROC) curve and its functional, viz., the area under ROC curve (AUC), estimated by quasi-maximum likelihood in the binormal model. Our simulation experiments confirm that this new method performs fairly well in finite samples, and confers an additional measure of robustness to nonnormality. The conventional procedure is found to be markedly undersized in terms of yielding empirical coverage probabilities lower than the nominal level, especially when the serial correlation is strong. An example from macroeconomic forecasting demonstrates the importance of accounting for serial correlation when the probability forecasts for real GDP declines are evaluated using ROC. Supplementary materials for this article are available online.
What problem does this paper attempt to address?