Kidney Failure Prediction Models: A Comprehensive External Validation Study in Patients with Advanced CKD

Chava L. Ramspek,Marie Evans,Christoph Wanner,Christiane Drechsler,Nicholas C. Chesnaye,Maciej Szymczak,Magdalena Krajewska,Claudia Torino,Gaetana Porto,Samantha Hayward,Fergus Caskey,Friedo W. Dekker,Kitty J. Jager,Merel van Diepen,the EQUAL Study Investigators
DOI: https://doi.org/10.1681/ASN.2020071077
2021-05-02
Journal of the American Society of Nephrology : JASN
Abstract:Background Various prediction models have been developed to predict the risk of kidney failure in patients with CKD. However, guideline-recommended models have yet to be compared head to head, their validation in patients with advanced CKD is lacking, and most do not account for competing risks. Methods To externally validate 11 existing models of kidney failure, taking the competing risk of death into account, we included patients with advanced CKD from two large cohorts: the European Quality Study (EQUAL), an ongoing European prospective, multicenter cohort study of older patients with advanced CKD, and the Swedish Renal Registry (SRR), an ongoing registry of nephrology-referred patients with CKD in Sweden. The outcome of the models was kidney failure (defined as RRT-treated ESKD). We assessed model performance with discrimination and calibration. Results The study included 1580 patients from EQUAL and 13,489 patients from SRR. The average c statistic over the 11 validated models was 0.74 in EQUAL and 0.80 in SRR, compared with 0.89 in previous validations. Most models with longer prediction horizons overestimated the risk of kidney failure considerably. The 5-year Kidney Failure Risk Equation (KFRE) overpredicted risk by 10%–18%. The four- and eight-variable 2-year KFRE and the 4-year Grams model showed excellent calibration and good discrimination in both cohorts. Conclusions Some existing models can accurately predict kidney failure in patients with advanced CKD. KFRE performed well for a shorter time frame (2 years), despite not accounting for competing events. Models predicting over a longer time frame (5 years) overestimated risk because of the competing risk of death. The Grams model, which accounts for the latter, is suitable for longer-term predictions (4 years). Significance Statement Most kidney failure prediction models have been developed and validated in cohorts of patients with a wide range of disease severity, without accounting for the competing risk of death. Models recommended by guidelines, currently used in the clinic, have not undergone a head-to-head comparison. This study provides a comprehensive external validation of kidney failure prediction tools in two cohorts of patients with advanced CKD, taking the competing risk of death into account. Models that predict over a longer time frame of 5 years overestimate risk due to the competing risk of death. In patients with advanced CKD, the eight-variable 2-year Kidney Failure Risk Equation is recommended for short-term predictions surrounding preparation for RRT. The 4-year Grams model, which accounts for competing risk, is most suitable for longer-term predictions. Visual
What problem does this paper attempt to address?