Nested and Repeated Cross Validation for Classification Model with High-Dimensional Data

Yi Zhong,Jianghua He,Prabhakar Chalise
DOI: https://doi.org/10.15446/rce.v43n1.80000
2020-01-01
Revista Colombiana de Estadística
Abstract:With the advent of high throughput technologies, the high-dimensional datasets are increasingly available. This has not only opened up new insight into biological systems but also posed analytical challenges. One important problem is the selection of informative feature-subset and prediction of the future outcome. It is crucial that models are not overfitted and give accurate results with new data. In addition, reliable identification of informative features with high predictive power (feature selection) is of interests in clinical settings. We propose a two-step framework for feature selection and classification model construction, which utilizes a nested and repeated cross-validation method. We evaluated our approach using both simulated data and two publicly available gene expression datasets. The proposed method showed comparatively better predictive accuracy for new cases than the standard cross-validation method.
What problem does this paper attempt to address?