Development and validation of a deep learning-based survival prediction model for pediatric glioma patients: A retrospective study using the SEER database and Chinese data
Yang Jiao,Jianan Ye,Wenjian Zhao,Zhicheng Fan,Yunpeng Kou,Shaochun Guo,Min Chao,Chao Fan,Peigang Ji,Jinghui Liu,Yulong Zhai,Yuan Wang,Na Wang,Liang Wang
DOI: https://doi.org/10.1016/j.compbiomed.2024.109185
2024-09-27
Abstract:Objective: Develop a time-dependent deep learning model to accurately predict the prognosis of pediatric glioma patients, which can assist clinicians in making precise treatment decisions and reducing patient risk. Study design: The study involved pediatric glioma patients from the Surveillance, Epidemiology, and End Results (SEER) Registry (2000-2018) and Tangdu Hospital in China (2010-2018) within specific time frames. For training, we selected two neural network-based algorithms (DeepSurv, neural multi-task logistic regression [N-MTLR]) and one ensemble learning-based algorithm (random survival forest [RSF]). Additionally, a multivariable Cox proportional hazard (CoxPH) model was developed for comparison purposes. The SEER dataset was randomly divided into 80 % for training and 20 % for testing, while the Tangdu Hospital dataset served as an external validation cohort. Super-parameters were fine-tuned through 1000 repeated random searches and 5-fold cross-validation on the training cohort. Model performance was assessed using the concordance index (C-index), Brier score, and Integrated Brier Score (IBS). Furthermore, the accuracy of predicting survival at 1, 3, and 5 years was evaluated using receiver operating characteristic (ROC) curves, calibration curves, and the area under the ROC curves (AUC). The generalization ability of the model was assessed using the C-index of the Tangdu Hospital data, ROC curves for 1, 3, and 5 years, and AUC values. Lastly, decision curve analysis (DCA) curves for 1, 3, and 5-year time frames are provided to assess the net benefits across different models. Results: A total of 9532 patients with pediatric glioma were included in this study, comprising 9274 patients from the SEER database and 258 patients from Tangdu Hospital in China. The average age at diagnosis was 9.4 ± 6.2 years, and the average survival time was 96 ± 66 months. Through comprehensive performance comparison, the DeepSurv model demonstrated the highest effectiveness, with a C-index of 0.881 on the training cohort. Furthermore, it exhibited excellent accuracy in predicting the 1-year, 3-year, and 5-year survival rates (AUC: 0.903-0.939). Notably, the DeepSurv model also achieved remarkable performance and accuracy on the Chinese dataset (C-index: 0.782, AUC: 0.761-0.852). Comprehensive analysis of DeepSurv, N-MTLR, and RSF revealed that tumor stage, radiotherapy, histological type, tumor size, chemotherapy, age, and surgical method are all significant factors influencing the prognosis of pediatric glioma. Finally, an online version of the pediatric glioma survival predictor based on the DeepSurv model has been established and can be accessed through https://pediatricglioma-tangdu.streamlit.app. Conclusions: The DeepSurv model exhibits exceptional efficacy in predicting the survival of pediatric glioma patients, demonstrating strong performance in discrimination, calibration, stability, and generalization. By utilizing the online version of the pediatric glioma survival predictor, which is based on the DeepSurv model, clinicians can accurately predict patient survival and offer personalized treatment options.