Abstract:In kidney transplantation, obtaining early information about the risk of graft failure helps physicians and patients anticipate a potential return to dialysis or retransplantation. Clinical prediction models are commonly used to obtain such risk estimation, but their performance needs to be continuously evaluated in various contexts. We propose an external validation study of the Kidney Transplant Failure Score in a pooled sample of 3,144 patients transplanted between 2010 and 2015 in France, Belgium, Norway and Canada. This score is used at the first transplantation anniversary to predict the probability of graft failure over the following seven years. The target population was defined as adult recipients of a kidney from a neurologically deceased donor without graft failure in the first year post-transplantation. Graft failure was defined as a return to dialysis. Around 10% of patients returned to dialysis, and 12.6% died during the seven-year follow-up. The KTFS authors fitted a Cox model and then adjusted its coefficients to maximize the discrimination, yielding the KTFS final version. We evaluated the performance of the initial and final versions of the KTFS, as well as the performance of another model we developed to consider death as a competing event. All KTFS versions yielded similarly good discrimination (area under the time-dependant receiver operating curve around from 0.79 [0.76-0.82] to 0.80 [0.77-0.84]), while the discrimination-optimized one presented important miscalibration. Clinical utility, assessed through net benefit, was also the lowest for the discrimination-optimized version. Our results warn against using the current KTFS version and recommend using either the initial coefficients or the competing risk-based ones instead.

What problem does this paper attempt to address?

### Problems the paper attempts to solve This paper aims to evaluate the external validation of the Kidney Transplant Failure Score (KTFs), especially in prospective cohorts in different countries in Europe and North America. Specifically, the research objectives are as follows: 1. **External validation**: Validate the predictive performance of KTFs in countries other than France (such as Belgium, Norway, and Canada), because its original development sample was limited to the French population. 2. **Comparison of different versions**: Evaluate the performance of different versions of KTFs (initial coefficients, coefficients for optimizing discriminative power, and coefficients considering competing risks) in predicting kidney transplant failure. 3. **Performance indicators**: Evaluate the predictive ability and clinical utility of the model through multiple statistical indicators (such as time - dependent area under the receiver operating characteristic curve (tAUC), calibration, Brier score, and decision - curve analysis). ### Background Kidney transplantation is the preferred method for treating end - stage renal disease, but long - term care after transplantation is crucial to reduce the need for re - transplantation. Clinical prediction models (CPMs) or prognostic scores can provide valuable information to help doctors and patients manage the disease. However, the performance of these models needs to be continuously evaluated in different contexts. KTFs is a predictive model developed by French researchers in the early 2000s to predict the risk of kidney transplant failure within the next seven years in the first year after transplantation. Although this model has been used in France for nearly 15 years, its performance in other regions has not been fully validated. ### Research methods - **Study population**: The study used data from the European Network (EKITE) and the Centre Hospitalier de l'Université de Montréal (CHUM) in Canada, covering 3,144 patients who received kidney transplants between 2010 and 2015. - **Data collection**: Collected characteristic data of donors and recipients, including age, gender, last serum creatinine level, cold ischemia time, HLA incompatibility, etc. - **Outcome definition**: The primary outcome was the time to transplant failure, defined as return to dialysis or re - transplantation, with a prediction window of seven years. - **Statistical analysis**: Used multiple statistical methods to evaluate the discriminative ability, calibration, and overall performance of the model, and considered the impact of competing risks (such as death). ### Results - **Patient characteristics**: The event rates (transplant failure and death) in the validation sample were higher than those in the original development sample. - **Predictive ability**: All versions of KTFs showed similar good discriminative ability (tAUC was approximately 0.80), but the version with optimized discriminative power had significant problems in calibration. - **Clinical utility**: Decision - curve analysis showed that using KTFs for clinical decision - making can improve the success rate of transplantation. ### Conclusion This study recommends avoiding the use of the current version of KTFs with optimized discriminative power, and instead using the initial coefficient or the version considering competing risks. This provides a more reliable prediction tool for kidney transplant patients and doctors.

A Canado-European external validation of the Kidney Transplant Failure Score

A Statistical Prediction Model for Survival after Kidney Transplantation from Deceased Donors

Competing and Noncompeting Risk Models for Predicting Kidney Allograft Failure

The impact of competing risks in kidney allograft failure prediction

Predicting outcomes after transplantation of deceased donor kidneys of marginal quality within the Eurotransplant service area

Clinical performance of the iPREDICTLIVING tool for the prediction of the post‐transplant recipient and living donor outcomes in a European cohort

Kidney Failure Prediction Models: A Comprehensive External Validation Study in Patients with Advanced CKD

Using Information Available at the Time of Donor Offer to Predict Kidney Transplant Survival Outcomes: A Systematic Review of Prediction Models

Prediction of Renal Graft Function 1 Year After Adult Deceased-Donor Kidney Transplantation Using Variables Available Prior to Transplantation

Pretransplant Renal Function Evaluated by Serum Cystatin C Was Associated with Mortality after Liver Transplantation: a Single-Center Experience

A competing risks model to estimate the risk of graft failure and patient death after kidney transplantation using continuous donor-recipient age combinations

Performance of risk prediction models for post-liver transplant patient and graft survival over time

2-Step-Scores with optional nephropathology for the prediction of adverse outcomes for brain-dead donor kidneys in Eurotransplant

Enhancing Vascular Access Planning in CKD: Validating the 40% KFRE Threshold for predicting ESKD in a French Retrospective Cohort Study

A 4-Variable Model to Predict Cardio-Kidney Events and Mortality in Chronic Kidney Disease: The Chronic Renal Insufficiency Cohort (CRIC) Study

Validation and performance of three scoring systems for predicting primary non-function and early allograft failure after liver transplantation

Optimal Timing of Serum Creatinine Measurement for KDPI Scoring to Predict Postoperative Renal Function in Deceased Donor Kidney Transplantation

Prolonged dialysis duration is associated with graft failure and mortality after kidney transplantation: results from the French transplant database

Predicting prognostic factors in kidney transplantation using a machine learning approach to enhance outcome predictions: a retrospective cohort study

Derivation and External Validation of Prediction Models for Advanced Chronic Kidney Disease Following Acute Kidney Injury

Predicting kidney allograft survival with explainable machine learning