Temporal validation of a Generalized Additive 2 models (GA 2 M) to assess the risk chronic kidney disease (CKD)
Francesco Lapi,Lorenzo Nuti,Iacopo Cricelli,Ettore Marconi,Claudio Cricelli
DOI: https://doi.org/10.1016/j.ijmedinf.2024.105440
IF: 4.73
2024-03-29
International Journal of Medical Informatics
Abstract:Objective To assess the temporal validity of a model predicting the risk of Chronic Kidney Disease (CKD) using Generalized Additive 2 Models (GA 2 M). Materials We adopted the Italian Health Search Database (HSD) with which the original algorithm was developed and validated by comparing different machine learnings models. Methods We selected all patients aged >=15 being active in HSD in 2019. They were followed up until December 2022 so being updated with three years of data collection. Those with prior diagnosis of CKD were excluded. A GA 2 M-based algorithm for CKD prediction was applied to this cohort in order to compare observed and predicted risk. Area Under Curve (AUC) and Average Precision (AP) were calculated. Results We obtained an AUC and AP equal to 88% and 30%, respectively. Discussion The prediction accuracy of the algorithm was largely consistent with that obtained in our prior work which was based on a different time-window for data collection. We therefore underlined and demonstrated the relevance of temporal validation for this prediction tool. Conclusion The GA 2 M confirmed its high accuracy in prediction of CKD. As such, the respective patient- and population-based informatic tools might be implemented in primary care.
health care sciences & services,computer science, information systems,medical informatics
What problem does this paper attempt to address?