Machine learning algorithms being an auxiliary tool to predict the overall survival of patients with renal cell carcinoma using the SEER database

Weixing Jiang,Zhenghao Chen,Cancan Chen,Lei Wang,Tiandong Han,Li Wen

DOI: https://doi.org/10.21037/tau-23-319

2024-01-27

Translational Andrology and Urology

Abstract:Keywords: Renal cell carcinoma (RCC); machine learning (ML); algorithm; prediction; prognosis

urology & nephrology,andrology

What problem does this paper attempt to address?

Evaluation of Machine Learning Algorithms for the Prognosis of Breast Cancer from the Surveillance, Epidemiology, and End Results Database

Ruiyang Wu,Jing Luo,Hangyu Wan,Haiyan Zhang,Yewei Yuan,Huihua Hu,Jinyan Feng,Jing Wen,Yan Wang,Junyan Li,Qi Liang,Fengjiao Gan,Gang Zhang

DOI: https://doi.org/10.1371/journal.pone.0280340

IF: 3.7

2023-01-01

PLoS ONE

Abstract:Introduction Many researchers used machine learning (ML) to predict the prognosis of breast cancer (BC) patients and noticed that the ML model had good individualized prediction performance. Objective The cohort study was intended to establish a reliable data analysis model by comparing the performance of 10 common ML algorithms and the the traditional American Joint Committee on Cancer (AJCC) stage, and used this model in Web application development to provide a good individualized prediction for others. Methods This study included 63145 BC patients from the Surveillance, Epidemiology, and End Results database. Results Through the performance of the 10 ML algorithms and 7th AJCC stage in the optimal test set, we found that in terms of 5-year overall survival, multivariate adaptive regression splines (MARS) had the highest area under the curve (AUC) value (0.831) and F1-score (0.608), and both sensitivity (0.737) and specificity (0.772) were relatively high. Besides, MARS showed a highest AUC value (0.831, 95%confidence interval: 0.820–0.842) in comparison to the other ML algorithms and 7th AJCC stage (all P < 0.05). MARS, the best performing model, was selected for web application development (https://w12251393.shinyapps.io/app2/). Conclusions The comparative study of multiple forecasting models utilizing a large data noted that MARS based model achieved a much better performance compared to other ML algorithms and 7th AJCC stage in individualized estimation of survival of BC patients, which was very likely to be the next step towards precision medicine.
Machine Learning Model for Predicting Postoperative Survival of Patients with Colorectal Cancer

Mohamed Hosny Osman,Reham Hosny Mohamed,Hossam Mohamed Sarhan,Eun Jung Park,Seung Hyuk Baik,Kang Young Lee,Jeonghyun Kang

DOI: https://doi.org/10.4143/crt.2021.206

IF: 5.036

2022-04-15

Cancer Research and Treatment

Abstract:Purpose Machine learning (ML) is a strong candidate for making accurate predictions, as we can use large amount of data with powerful computational algorithms. We developed a ML based model to predict survival of patients with colorectal cancer (CRC) using data from two independent datasets.Materials and Methods A total of 364,316 and 1,572 CRC patients were included from the Surveillance, Epidemiology, and End Results (SEER) and a Korean dataset, respectively. As SEER combines data from 18 cancer registries, internal validation was done using 18-Fold-Cross-Validation then external validation was performed by testing the trained model on the Korean dataset. Performance was evaluated using area under the receiver operating characteristic curve (AUROC), sensitivity and positive predictive values.Results Clinicopathological characteristics were significantly different between the two datasets and the SEER showed a significant lower 5-year survival rate compared to the Korean dataset (60.1% vs. 75.3%, p < 0.001). The ML-based model using the Light gradient boosting algorithm achieved a better performance in predicting 5-year-survival compared to American Joint Committee on Cancer stage (AUROC, 0.804 vs. 0.736; p < 0.001). The most important features which influenced model performance were age, number of examined lymph nodes, and tumor size. Sensitivity and positive predictive values of predicting 5-year-survival for classes including dead or alive were reported as 68.14%, 77.51% and 49.88%, 88.1% respectively in the validation set. Survival probability can be checked using the web-based survival predictor (http://colorectalcancer.pythonanywhere.com).Conclusion ML-based model achieved a much better performance compared to staging in individualized estimation of survival of patients with CRC.

oncology
Prediction of lung cancer patient survival via supervised machine learning classification techniques

Chip M. Lynch,Behnaz Abdollahi,Joshua D. Fuqua,Alexandra R. de Carlo,James A. Bartholomai,Rayeanne N. Balgemann,Victor H. van Berkel,Hermann B. Frieboes

DOI: https://doi.org/10.1016/j.ijmedinf.2017.09.013

IF: 4.73

2017-12-01

International Journal of Medical Informatics

Abstract:Outcomes for cancer patients have been previously estimated by applying various machine learning techniques to large datasets such as the Surveillance, Epidemiology, and End Results (SEER) program database. In particular for lung cancer, it is not well understood which types of techniques would yield more predictive information, and which data attributes should be used in order to determine this information. In this study, a number of supervised learning techniques is applied to the SEER database to classify lung cancer patients in terms of survival, including linear regression, Decision Trees, Gradient Boosting Machines (GBM), Support Vector Machines (SVM), and a custom ensemble. Key data attributes in applying these methods include tumor grade, tumor size, gender, age, stage, and number of primaries, with the goal to enable comparison of predictive power between the various methods The prediction is treated like a continuous target, rather than a classification into categories, as a first step towards improving survival prediction. The results show that the predicted values agree with actual values for low to moderate survival times, which constitute the majority of the data. The best performing technique was the custom ensemble with a Root Mean Square Error (RMSE) value of 15.05. The most influential model within the custom ensemble was GBM, while Decision Trees may be inapplicable as it had too few discrete outputs. The results further show that among the five individual models generated, the most accurate was GBM with an RMSE value of 15.32. Although SVM underperformed with an RMSE value of 15.82, statistical analysis singles the SVM as the only model that generated a distinctive output. The results of the models are consistent with a classical Cox proportional hazards model used as a reference technique. We conclude that application of these supervised learning techniques to lung cancer data in the SEER database may be of use to estimate patient survival time with the ultimate goal to inform patient care decisions, and that the performance of these techniques with this particular dataset may be on par with that of classical methods.
Machine learning for predicting liver and/or lung metastasis in colorectal cancer: a retrospective study based on the SEER database

Zhentian Guo,Zongming Zhang,Limin Liu,Yue Zhao,Zhuo Liu,Chong Zhang,Hui Qi,Jinqiu Feng,Chunmin Yang,Weiping Tai,Filippo Banchini,Riccardo Inchingolo

DOI: https://doi.org/10.1016/j.ejso.2024.108362

IF: 4.037

2024-04-29

European Journal of Surgical Oncology

Abstract:Objective This study aims to establish a machine learning (ML) model for predicting the risk of liver and/or lung metastasis in colorectal cancer (CRC). Methods Using the National Institutes of Health (NIH)'s Surveillance, Epidemiology, and End Results (SEER) database, a total of 51265 patients with pathological diagnosis of colorectal cancer from 2010 to 2015 were extracted for model development. On this basis, We have established 7 machine learning algorithm models. Evaluate the model based on accuracy, and AUC of receiver operating characteristics (ROC) and explain the relationship between clinical pathological features and target variables based on the best model. We validated the model among 196 colorectal cancer patients in Beijing Electric Power Hospital of Capital Medical University of China to evaluate its performance and universality. Finally, we have developed a network-based calculator using the best model to predict the risk of liver and/or lung metastasis in colorectal cancer patients. Results 51265 patients were enrolled in the study, of which 7864 (15.3%) had distant liver and/or lung metastasis. RF has the best predictive ability, In the internal test set, with an accuracy of 0.895, AUC of 0.956, and AUPR of 0.896. In addition, the RF model was evaluated in the external validation set with an accuracy of 0.913, AUC of 0.912, and AUPR of 0.611. Conclusion In this study, we constructed an RF algorithm mode to predict the risk of colorectal liver and/or lung metastasis, to assist doctors in making clinical decisions.

oncology,surgery
Development and validation of a machine learning model to predict the risk of lymph node metastasis in renal carcinoma

Xiaowei Feng,Tao Hong,Wencai Liu,Chan Xu,Wanying Li,Bing Yang,Yang Song,Ting Li,Wenle Li,Hui Zhou,Chengliang Yin

DOI: https://doi.org/10.3389/fendo.2022.1054358

2022-11-18

Abstract:Simple summary: Studies have shown that about 30% of kidney cancer patients will have metastasis, and lymph node metastasis (LNM) may be related to a poor prognosis. Our retrospective study aims to provide a reliable machine learning-based model to predict the occurrence of LNM in kidney cancer. We screened the pathological grade, liver metastasis, M staging, primary site, T staging, and tumor size from the training group (n=39016) formed by the SEER database and the validation group (n=771) formed by the medical center. Independent predictors of LNM in cancer patients. Using six different algorithms to build a prediction model, it is found that the prediction performance of the XGB model in the training group and the validation group is significantly better than any other machine learning model. The results show that prediction tools based on machine learning can accurately predict the probability of LNM in patients with kidney cancer and have satisfactory clinical application prospects. Background: Lymph node metastasis (LNM) is associated with the prognosis of patients with kidney cancer. This study aimed to provide reliable machine learning-based (ML-based) models to predict the probability of LNM in kidney cancer. Methods: Data on patients diagnosed with kidney cancer were extracted from the Surveillance, Epidemiology and Outcomes (SEER) database from 2010 to 2017, and variables were filtered by least absolute shrinkage and selection operator (LASSO), univariate and multivariate logistic regression analyses. Statistically significant risk factors were used to build predictive models. We used 10-fold cross-validation in the validation of the model. The area under the receiver operating characteristic curve (AUC) was used to assess the performance of the model. Correlation heat maps were used to investigate the correlation of features using permutation analysis to assess the importance of predictors. Probability density functions (PDFs) and clinical utility curves (CUCs) were used to determine clinical utility thresholds. Results: The training cohort of this study included 39,016 patients, and the validation cohort included 771 patients. In the two cohorts, 2544 (6.5%) and 66 (8.1%) patients had LNM, respectively. Pathological grade, liver metastasis, M stage, primary site, T stage, and tumor size were independent predictive factors of LNM. In both model validation, the XGB model significantly outperformed any of the machine learning models with an AUC value of 0.916.A web calculator (https://share.streamlit.io/liuwencai4/renal_lnm/main/renal_lnm.py) were built based on the XGB model. Based on the PDF and CUC, we suggested 54.6% as a threshold probability for guiding the diagnosis of LNM, which could distinguish about 89% of LNM patients. Conclusions: The predictive tool based on machine learning can precisely indicate the probability of LNM in kidney cancer patients and has a satisfying application prospect in clinical practice.
Application of Machine Learning Models to Predict Recurrence After Surgical Resection of Nonmetastatic Renal Cell Carcinoma

Zine-Eddine Khene,Pierre Bigot,Nicolas Doumerc,Idir Ouzaid,Romain Boissier,François-Xavier Nouhaud,Laurence Albiges,Jean-Christophe Bernhard,Alexandre Ingels,Delphine Borchiellini,Solène Kammerer-Jacquet,Nathalie Rioux-Leclercq,Morgan Roupret,Oscar Acosta,Renaud De Crevoisier,Karim Bensalah,Géraldine Pignot,Youness Ahallal,Cedric Lebacle,Arnaud Méjean,Jean-Alexandre Long,Xavier Tillou,Jonathan Olivier,Franck Bruyère,Thomas Charles,Xavier Durand,Hervé Lang,Stéphane Larre

DOI: https://doi.org/10.1016/j.euo.2022.07.007

IF: 8.208

2022-08-01

European Urology Oncology

Abstract:BACKGROUND: Predictive tools can be useful for adapting surveillance or including patients in adjuvant trials after surgical resection of nonmetastatic renal cell carcinoma (RCC). Current models have been built using traditional statistical modelling and prespecified variables, which limits their performance.OBJECTIVE: To investigate the performance of machine learning (ML) framework to predict recurrence after RCC surgery and compare them with current validated models.DESIGN, SETTING, AND PARTICIPANTS: In this observational study, we derived and tested several ML-based models (Random Survival Forests [RSF], Survival Support Vector Machines [S-SVM], and Extreme Gradient Boosting [XG boost]) to predict recurrence of patients who underwent radical or partial nephrectomy for a nonmetastatic RCC, between 2013 and 2020, at 21 French medical centres.OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS: The primary end point was disease-free survival. Model discrimination was assessed using the concordance index (c-index), and calibration was assessed using the Brier score. ML models were compared with four conventional prognostic models, using decision curve analysis (DCA).RESULTS AND LIMITATIONS: A total of 4067 patients were included in this study (3253 in the development cohort and 814 in the validation cohort). Most tumours (69%) were clear cell RCC, 40% were of high grade (nuclear International Society of Urological Pathology grade 3 or 4), and 24% had necrosis. Of the patients, 4% had nodal involvement. After a median follow-up of 57 mo (interquartile range 29-76), 523 (13%) patients recurred. ML models obtained higher c-index values than conventional models. The RSF yielded the highest c-index values (0.794), followed by S-SVM (c-index 0.784) and XG boost (c-index 0.782). In addition, all models showed good calibration with low integrated Brier scores (all integrated brier scores <0.1). However, we found calibration drift over time for all models, albeit with a smaller magnitude for ML models. Finally, DCA showed an incremental net benefit from all ML models compared with conventional models currently used in practice.CONCLUSIONS: Applying ML approaches to predict recurrence following surgical resection of RCC resulted in better prediction than that of current validated models available in clinical practice. However, there is still room for improvement, which may come from the integration of novel biological and/or imaging biomarkers.PATIENT SUMMARY: We found that artificial intelligence algorithms could better predict the risk of recurrence after surgery for a localised kidney cancer. These algorithms may help better select patients who will benefit from medical treatment after surgery.

oncology,urology & nephrology
A Nomogram Predicting the Prognosis of Renal Cell Carcinoma Patients with Lung Metastases

Xinyu Sheng,Xuan Lu,Jian Wu,Lu Chen,Hong Cao

DOI: https://doi.org/10.1155/2021/6627562

2021-01-01

BioMed Research International

Abstract:Background The optimal tool for predicting the survival of renal cell carcinoma (RCC) patients with lung metastases remains controversial. Methods We selected patients diagnosed with RCC and lung metastases, from 2010 to 2015, from the Surveillance, Epidemiology, and End Results (SEER) database. After the selection of inclusion criteria and exclusion criterion, the rest of the patients were incorporated into model analysis. Least absolute shrinkage and selection operator (LASSO) regression was used to select the most important features for construction of a nomogram predicting cancer-specific survival. A calibration plot and the concordance index (C-index) were used to estimate nomogram efficacy in a validation cohort. The association between important factors selected by LASSO regression, and prognosis was assessed by the Kaplan-Meier (KM) survival curve. The receiver operating characteristic (ROC) curves were drawn to compare sensitivity and specificity between the nomogram we built and the TNM stage-based model. Results A total of 1,369 patients met the inclusion criteria, but not the exclusion criteria. The LASSO regression model reduced 15 features to seven potential predictors of survival, including tumor grade, the extent of surgery, N and T status, histological profile, and brain and bone metastasis status. Such features had good discrimination in the KM survival curves. The nomogram showed excellent discriminatory power (C-index, 0.71; 95% confidence interval: 0.70 to 0.72) and good calibration in terms of both 1- and 2-year cancer-specific survival. The nomogram showed great discriminatory power (C-index 0.68) and adequate calibration when applied to the validation cohort. The areas under the curve (AUCs) of nomogram were 0.767 and 0.780, respectively, and the AUCs of TNM stage were 0.617 and 0.618 at 1 and 2 years, respectively. Conclusions Our nomogram might play a major role in predicting the cancer-specific survival of RCC patients with lung metastases.
AI predictive modeling of survival outcomes for renal cancer patients undergoing targeted therapy

Yaoqi Yu,Jirui Niu,Yin Yu,Silong Xia,Shiheng Sun

DOI: https://doi.org/10.1038/s41598-024-77638-6

IF: 4.6

2024-10-31

Scientific Reports

Abstract:Renal clear cell cancer (RCC) is a complex disease that is challenging to predict patient outcomes. Despite improvements with targeted therapy, personalized treatment planning is still needed. Artificial intelligence (AI) can help address this challenge by developing predictive models that accurately forecast patient survival periods. With AI-powered decision support, clinicians can provide patients with tailored treatment plans, enhancing treatment efficacy and quality of life. The study analyzed 267 patients with renal clear cell carcinoma, focusing on 26 who received targeted drug therapy. The data was refined by excluding 8 patients without enhanced CT scans. The research team categorized patients into two groups based on their expected lifespan: Group 1 (over 3 years) and Group 2 (under 3 years). The UPerNet algorithm was used to extract features from CT tumor markers, validating their effectiveness. These features were then used to develop an AI-based predictive model trained on the dataset. The developed AI model demonstrated remarkable accuracy, achieving a rate of 93.66% in Group 1 and 94.14% in Group 2. In conclusion, our study demonstrates the potential of AI technology in predicting the survival time of RCC patients undergoing targeted drug therapy. The established prediction model exhibits high predictive accuracy and stability, serving as a valuable tool for clinicians to facilitate the development of more personalized treatment plans for patients. This study highlights the importance of integrating AI technology in clinical decision-making, enabling patients to receive more effective and targeted treatment plans that enhance their overall quality of life.

multidisciplinary sciences
Bone metastasis risk and prognosis assessment models for kidney cancer based on machine learning

Lichen Ji,Wei Zhang,Jiaqing Huang,Jinlong Tian,Xugang Zhong,Junchao Luo,Senbo Zhu,Zeju He,Yu Tong,Xiang Meng,Yao Kang,Qing Bi

DOI: https://doi.org/10.3389/fpubh.2022.1015952

IF: 5.2

2022-11-17

Frontiers in Public Health

Abstract:Background Bone metastasis is a common adverse event in kidney cancer, often resulting in poor survival. However, tools for predicting KCBM and assessing survival after KCBM have not performed well. Methods The study uses machine learning to build models for assessing kidney cancer bone metastasis risk, prognosis, and performance evaluation. We selected 71,414 kidney cancer patients from SEER database between 2010 and 2016. Additionally, 963 patients with kidney cancer from an independent medical center were chosen to validate the performance. In the next step, eight different machine learning methods were applied to develop KCBM diagnosis and prognosis models while the risk factors were identified from univariate and multivariate logistic regression and the prognosis factors were analyzed through Kaplan-Meier survival curve and Cox proportional hazards regression. The performance of the models was compared with current models, including the logistic regression model and the AJCC TNM staging model, applying receiver operating characteristics, decision curve analysis, and the calculation of accuracy and sensitivity in both internal and independent external cohorts. Results Our prognosis model achieved an AUC of 0.8269 (95%CI: 0.8083–0.8425) in the internal validation cohort and 0.9123 (95%CI: 0.8979–0.9261) in the external validation cohort. In addition, we tested the performance of the extreme gradient boosting model through decision curve analysis curve, Precision-Recall curve, and Brier score and two models exhibited excellent performance. Conclusion Our developed models can accurately predict the risk and prognosis of KCBM and contribute to helping improve decision-making.

public, environmental & occupational health
Artificial intelligence for diagnosing and predicting survival of patients with renal cell carcinoma: Retrospective multi-center study

Siteng Chen,Xiyue Wang,Jun Zhang,Liren Jiang,Ning Zhang,Feng Gao,Wei Yang,Jinxi Xiang,Sen Yang,Junhua Zheng,Xiao Han

DOI: https://doi.org/10.48550/arXiv.2301.04889

2023-01-12

Image and Video Processing

Abstract:Background: Clear cell renal cell carcinoma (ccRCC) is the most common renal-related tumor with high heterogeneity. There is still an urgent need for novel diagnostic and prognostic biomarkers for ccRCC. Methods: We proposed a weakly-supervised deep learning strategy using conventional histology of 1752 whole slide images from multiple centers. Our study was demonstrated through internal cross-validation and external validations for the deep learning-based models. Results: Automatic diagnosis for ccRCC through intelligent subtyping of renal cell carcinoma was proved in this study. Our graderisk achieved aera the curve (AUC) of 0.840 (95% confidence interval: 0.805-0.871) in the TCGA cohort, 0.840 (0.805-0.871) in the General cohort, and 0.840 (0.805-0.871) in the CPTAC cohort for the recognition of high-grade tumor. The OSrisk for the prediction of 5-year survival status achieved AUC of 0.784 (0.746-0.819) in the TCGA cohort, which was further verified in the independent General cohort and the CPTAC cohort, with AUC of 0.774 (0.723-0.820) and 0.702 (0.632-0.765), respectively. Cox regression analysis indicated that graderisk, OSrisk, tumor grade, and tumor stage were found to be independent prognostic factors, which were further incorporated into the competing-risk nomogram (CRN). Kaplan-Meier survival analyses further illustrated that our CRN could significantly distinguish patients with high survival risk, with hazard ratio of 5.664 (3.893-8.239, p < 0.0001) in the TCGA cohort, 35.740 (5.889-216.900, p < 0.0001) in the General cohort and 6.107 (1.815 to 20.540, p < 0.0001) in the CPTAC cohort. Comparison analyses conformed that our CRN outperformed current prognosis indicators in the prediction of survival status, with higher concordance index for clinical prognosis.
Predicting Overall Survival in Patients with Nonmetastatic Gastric Signet Ring Cell Carcinoma: A Machine Learning Approach.

Xiaomei Li,Zhiwei Chen,Jing Lin,Shouan Wang,Conghua Song

DOI: https://doi.org/10.1155/2022/4862376

IF: 2.809

2022-01-01

Computational and Mathematical Methods in Medicine

Abstract:Background and Aims:Accurate prediction is essential for the survival of patients with nonmetastatic gastric signet ring cell carcinoma (GSRC) and medical decision-making. Current models rely on prespecified variables, limiting their performance and not being suitable for individual patients. Our study is aimed at developing a more precise model for predicting 1-, 3-, and 5-year overall survival (OS) in patients with nonmetastatic GSRC based on a machine learning approach.Methods:We selected 2127 GSRC patients diagnosed from 2004 to 2014 from the Surveillance, Epidemiology, and End Results (SEER) database and then randomly partitioned them into a training and validation cohort. We compared the performance of several machine learning-based models and finally chose the eXtreme gradient boosting (XGBoost) model as the optimal method to predict the OS in patients with nonmetastatic GSRC. The model was assessed using the receiver operating characteristic curve (ROC).Results:In the training cohort, for predicting OS rates at 1-, 3-, and 5-year, the AUCs of the XGBoost model were 0.842, 0.831, and 0.838, respectively, while in the testing cohort, the AUCs of 1-, 3-, and 5-year OS rates were 0.749, 0.823, and 0.829, respectively. Besides, the XGBoost model also performed better when compared with the American Joint Committee on Cancer (AJCC) stage. The performance for this model was stably maintained when stratified by age and ethnicity.Conclusion:The XGBoost-based model accurately predicts the 1-, 3-, and 5-year OS in patients with nonmetastatic GSRC. Machine learning is a promising way to predict the survival outcomes of tumor patients.
Personalized three-year survival prediction and prognosis forecast by interpretable machine learning for pancreatic cancer patients: a population-based study and an external validation

Buwei Teng,Xiaofeng Zhang,Mingshu Ge,Miao Miao,Wei Li,Jun Ma

DOI: https://doi.org/10.3389/fonc.2024.1488118

IF: 4.7

2024-10-22

Frontiers in Oncology

Abstract:Purpose: The overall survival of patients with pancreatic cancer is extremely low. We aimed to establish machine learning (ML) based model to accurately predict three-year survival and prognosis of pancreatic cancer patients. Methods: We analyzed pancreatic cancer patients from the Surveillance, Epidemiology, and End Results (SEER) database between 2000 and 2021. Univariate and multivariate logistic analysis were employed to select variables. Recursive Feature Elimination (RFE) method based on 6 ML algorithms was utilized in feature selection. To construct predictive model, 13 ML algorithms were evaluated by area under the curve (AUC), area under precision-recall curve (PRAUC), accuracy, sensitivity, specificity, precision, cross-entropy, Brier scores and Balanced Accuracy (bacc) and F Beta Score (fbeta). An optimal ML model was constructed to predict three-year survival, and the predictive results were explained by SHapley Additive exPlanations (SHAP) framework. Meanwhile, 101 ML algorithm combinations were developed to select the best model with highest C-index to predict prognosis of pancreatic cancer patients. Results: A total of 20,064 pancreatic cancer patients from SEER database was consecutively enrolled. We utilized eight clinical variables to establish prediction model for three-year survival. CatBoost model was selected as the best prediction model, and AUC was 0.932 [0.924, 0.939], 0.899 [0.873, 0.934] and 0.826 [0.735, 0.919] in training, internal test and external test sets, with 0.839 [0.831, 0.847] accuracy, 0.872 [0.858, 0.887] sensitivity, 0.803 [0.784, 0.825] specificity and 0.832 [0.821, 0.853] precision. Surgery type had the greatest effects on three-year survival according to SHAP results. For prognosis prediction, "RSF+GBM" algorithm was the best prognostic model with C-index of 0.774, 0.722 and 0.674 in training, internal test and external test sets. Conclusions: Our ML models demonstrate excellent accuracy and reliability, offering more precise personalized prognostic prediction to pancreatic cancer patients.

oncology
Machine Learning Predict Survivals of Spinal and Pelvic Ewing's Sarcoma with the SEER Database.

Guoxin Fan,Sheng Yang,Jiaqi Qin,Longfei Huang,Yufeng Li,Huaqing Liu,Xiang Liao

DOI: https://doi.org/10.1177/21925682221134049

2024-01-01

Global Spine Journal

Abstract:STUDY DESIGN:Retrospective Cohort Study. OBJECTIVES:This study aimed to develop survival prediction models for spinal Ewing's sarcoma (EWS) based on machine learning (ML). METHODS:We extracted the SEER registry's clinical data of EWS diagnosed between 1975 and 2016. Three feature selection methods extracted clinical features. Four ML algorithms (Cox, random survival forest (RSF), CoxBoost, DeepCox) were trained to predict the overall survival (OS) and cancer-specific survival (CSS) of spinal EWS. The concordance index (C-index), integrated Brier score (IBS) and mean area under the curves (AUC) were used to assess the prediction performance of different ML models. The top initial ML models with best performance from each evaluation index (C-index, IBS and mean AUC) were finally stacked to ensemble models which were compared with the traditional TNM stage model by 3-/5-/10-year Receiver Operating Characteristic (ROC) curves and Decision Curve Analysis (DCA). RESULTS:A total of 741 patients with spinal EWS were identified. C-index, IBS and mean AUC for the final ensemble ML model in predicting OS were .693/0.158/0.829 during independent testing, while .719/0.171/0.819 in predicting CSS. The ensemble ML model also achieved an AUC of .705/0.747/0.851 for predicting 3-/5-/10-year OS during independent testing, while .734/0.779/0.830 for predicting 3-/5-/10-year CSS, both of which outperformed the traditional TNM stage. DCA curves also showed the advantages of the ensemble models over the traditional TNM stage. CONCLUSION:ML was an effective and promising technique in predicting survival of spinal EWS, and the ensemble models were superior to the traditional TNM stage model.
Dynamic Predictive Models with Visualized Machine Learning for Assessing the Risk of Lung Metastasis in Kidney Cancer Patients

Chan Xu,Qian Zhou,Wencai Liu,Wenle Li,Shengtao Dong,Wanying Li,Xiaofeng Xu,Ximin Qiao,Youli Jiang,Jingfang Chen,Chengliang Yin

DOI: https://doi.org/10.1155/2022/5798602

IF: 4.501

2022-10-16

Journal of Oncology

Abstract:Objective. To establish and verify the clinical prediction model of lung metastasis in renal cancer patients. Method. Kidney cancer patients from January 1, 2010, to December 31, 2017, in the SEER database were enrolled in this study. In the first section, LASSO method was adopted to select variables. Independent influencing factors were identified after multivariate logistic regression analysis. In the second section, machine learning (ML) algorithms were implemented to establish models and 10-foldcross-validation was used to train the models. Finally, receiver operating characteristic curves, probability density functions, and clinical utility curve were applied to estimate model's performance. The final model was shown by a website calculator. Result. Lung metastasis was confirmed in 7.43% (3171 out of 42650) of study population. In multivariate logistic regression, bone metastasis, brain metastasis, grade, liver metastasis, N stage, T stage, and tumor size were independent risk factors of lung metastasis in renal cancer patients. Primary site and sequence number were independent protection factors of LM in renal cancer patients. The above 9 impact factors were used to develop the prediction models, which included random forest (RF), naive Bayes classifier (NBC), decision tree (DT), xgboost (XGB), gradient boosting machine (GBM), and logistic regression (LR). In 10-foldcross-validation, the average area under curve (AUC) ranked from 0.907 to 0.934. In ROC curve analysis, AUC ranged from 0.879–0.922. We found that the XGB model performed best, and a Web-based calculator was done according to XGB model. Conclusion. This study provided preliminary evidence that the ML algorithm can be used to predict lung metastases in patients with kidney cancer. This low cost, noninvasive and easy to implement diagnostic method is useful for clinical work. Of course this model still needs to undergo more real-world validation.

oncology
Leveraging SEER data through machine learning to predict distant lymph node metastasis and prognosticate outcomes in hepatocellular carcinoma patients

Jiaxuan Sun,Lei Huang,Yahui Liu

DOI: https://doi.org/10.1002/jgm.3732

Abstract:Objectives: This study aims to develop and validate machine learning-based diagnostic and prognostic models to predict the risk of distant lymph node metastases (DLNM) in patients with hepatocellular carcinoma (HCC) and to evaluate the prognosis for this cohort. Design: Utilizing a retrospective design, this investigation leverages data extracted from the Surveillance, Epidemiology, and End Results (SEER) database, specifically the January 2024 subset, to conduct the analysis. Participants: The study cohort consists of 15,775 patients diagnosed with HCC as identified within the SEER database, spanning 2016 to 2020. Method: In the construction of the diagnostic model, recursive feature elimination (RFE) is employed for variable selection, incorporating five critical predictors: age, tumor size, radiation therapy, T-stage, and serum alpha-fetoprotein (AFP) levels. These variables are the foundation for a stacking ensemble model, which is further elucidated through Shapley Additive Explanations (SHAP). Conversely, the prognostic model is crafted utilizing stepwise backward regression to select pertinent variables, including chemotherapy, radiation therapy, tumor size, and age. This model culminates in the development of a prognostic nomogram, underpinned by the Cox proportional hazards model. Main outcome measures: The outcome of the diagnostic model is the occurrence of DLNM in patients. The outcome of the prognosis model is determined by survival time and survival status. Results: The integrated model developed based on stacking demonstrates good predictive performance and high interpretative variability and differentiation. The area under the curve (AUC) in the training set is 0.767, while the AUC in the validation set is 0.768. The nomogram, constructed using the Cox model, also demonstrates consistent and strong predictive capabilities. At the same time, we recognized elements that have a substantial impact on DLNM and the prognosis and extensively discussed their significance in the model and clinical practice. Conclusion: Our study identified key predictive factors for DLNM and elucidated significant prognostic indicators for HCC patients with DLNM. These findings provide clinicians with valuable tools to accurately identify high-risk individuals for DLNM and conduct more precise risk stratification for this patient subgroup, potentially improving management strategies and patient outcomes.
The Application and Comparison of Machine Learning Models for the Prediction of Breast Cancer Prognosis: Retrospective Cohort Study

Jialong Xiao,Miao Mo,Zezhou Wang,Changming Zhou,Jie Shen,Jing Yuan,Yulian He,Ying Zheng

DOI: https://doi.org/10.2196/33440

IF: 3.2

2022-02-18

JMIR Medical Informatics

Abstract:Background Over the recent years, machine learning methods have been increasingly explored in cancer prognosis because of the appearance of improved machine learning algorithms. These algorithms can use censored data for modeling, such as support vector machines for survival analysis and random survival forest (RSF). However, it is still debated whether traditional (Cox proportional hazard regression) or machine learning-based prognostic models have better predictive performance. Objective This study aimed to compare the performance of breast cancer prognostic prediction models based on machine learning and Cox regression. Methods This retrospective cohort study included all patients diagnosed with breast cancer and subsequently hospitalized in Fudan University Shanghai Cancer Center between January 1, 2008, and December 31, 2016. After all exclusions, a total of 22,176 cases with 21 features were eligible for model development. The data set was randomly split into a training set (15,523 cases, 70%) and a test set (6653 cases, 30%) for developing 4 models and predicting the overall survival of patients diagnosed with breast cancer. The discriminative ability of models was evaluated by the concordance index (C-index), the time-dependent area under the curve, and D-index; the calibration ability of models was evaluated by the Brier score. Results The RSF model revealed the best discriminative performance among the 4 models with 3-year, 5-year, and 10-year time-dependent area under the curve of 0.857, 0.838, and 0.781, a D-index of 7.643 (95% CI 6.542, 8.930) and a C-index of 0.827 (95% CI 0.809, 0.845). The statistical difference of the C-index was tested, and the RSF model significantly outperformed the Cox-EN (elastic net) model (C-index 0.816, 95% CI 0.796, 0.836; P=.01), the Cox model (C-index 0.814, 95% CI 0.794, 0.835; P=.003), and the support vector machine model (C-index 0.812, 95% CI 0.793, 0.832; P<.001). The 4 models’ 3-year, 5-year, and 10-year Brier scores were very close, ranging from 0.027 to 0.094 and less than 0.1, which meant all models had good calibration. In the context of feature importance, elastic net and RSF both indicated that TNM staging, neoadjuvant therapy, number of lymph node metastases, age, and tumor diameter were the top 5 important features for predicting the prognosis of breast cancer. A final online tool was developed to predict the overall survival of patients with breast cancer. Conclusions The RSF model slightly outperformed the other models on discriminative ability, revealing the potential of the RSF method as an effective approach to building prognostic prediction models in the context of survival analysis.

medical informatics
Machine learning‐based prediction of survival prognosis in esophageal squamous cell carcinoma

Kaijiong Zhang,Bo Ye,Lichun Wu,Sujiao Ni,Yang Li,Qifeng Wang,Peng Zhang,Dongsheng Wang

DOI: https://doi.org/10.1038/s41598-023-40780-8

IF: 4.6

2023-08-21

Scientific Reports

Abstract:The current prognostic tools for esophageal squamous cell carcinoma (ESCC) lack the necessary accuracy to facilitate individualized patient management strategies. To address this issue, this study was conducted to develop a machine learning (ML) prediction model for ESCC patients' survival management. Six ML approaches, including Rpart, Elastic Net, GBM, Random Forest, GLMboost, and the machine learning-extended CoxPH method, were employed to develop risk prediction models. The model was trained on a dataset of 1954 ESCC patients with 27 clinical features and validated on a dataset of 487 ESCC patients. The discriminative performance of the models was assessed using the concordance index (C-index). The best performing model was used for risk stratification and clinical evaluation. The study found that N stage, T stage, surgical margin, tumor grade, tumor length, sex, MPV, AST, FIB, and Mg are the important feature for ESCC patients' survival. The machine learning-extended CoxPH model, Elastic Net, and Random Forest had similar performance in predicting the mortality risk of ESCC patients, and outperformed GBM, GLMboost, and Rpart. The risk scores derived from the CoxPH model effectively stratified ESCC patients into low-, intermediate-, and high-risk groups with distinctly different 3-year overall survival (OS) probabilities of 80.8%, 58.2%, and 29.5%, respectively. This risk stratification was also observed in the validation cohort. Furthermore, the risk model demonstrated greater discriminative ability and net benefit than the AJCC8th stage, suggesting its potential as a prognostic tool for predicting survival events and guiding clinical decision-making. The classical algorithm of the CoxPH method was also found to be sufficiently good for interpretive studies.

multidisciplinary sciences
Survival Prediction in Non-Small Cell Lung Cancer Patients: Performance Evaluation of Machine Learning Ensemble Models (Preprint)

Jianguo Sun,Lingchen Li,Anni Zhang,Chenrui Yin,Dingqin Cai,Yi Wang,Lijiao Xie,Lvjun Yan,Kai Niu,Jianbo Luo,Xiaoyan Shi,Chunli Jian,Linpeng Zheng,Fang Bin,Zhou Yi,Liu Zepeng

DOI: https://doi.org/10.2196/preprints.66993

2024-01-01

Abstract:Non-small cell lung cancer (NSCLC) represents the foremost cause of cancer-related mortality, underscoring the need for precise prognostic tools to enhance clinical decision-making. Existing models often fall short in providing reliable survival predictions. This study aims to develop a robust machine learning ensemble model to refine survival probability estimations for NSCLC patients and support clinical decisions. Following the application of inclusion and exclusion criteria, we utilized the SEER cohort to identify 93,828 NSCLC patients diagnosed between 2004 and 2019. The dataset was partitioned into training (70%) and testing (30%) subsets. Spearman correlation and univariate Cox regression analyses were conducted to identify significant variables influencing overall survival. A soft voting ensemble model was constructed, integrating MLP, XGBoost, and Random Forest algorithms. Model performance was assessed using Area Under the Curve (AUC) and decision curve analysis (DCA) in both the training and internal validation datasets. An external validation cohort comprising 325 NSCLC patients from our hospital (2015-2023) was used to evaluate generalizability. Eleven critical variables were identified: sex, age, histologic type, tumor grade, tumor size, N stage, M stage, and metastases (bone, lung, brain, liver). The soft voting ensemble model yielded AUCs of 0.819, 0.818, and 0.819 for predicting 1-year, 3-year, and 5-year survival in the internal test set, respectively, demonstrating substantial predictive accuracy. External validation produced AUCs of 0.809, 0.793, and 0.800. DCA affirmed the model’s clinical relevance. SHapley Additive exPlanations (SHAP) analysis highlighted tumor size, N stage, and M stage as the most influential factors. The soft voting ensemble model offers a highly accurate prognostic tool for NSCLC survival prediction, significantly enhancing clinical prognosis. SHAP feature importance analysis further supports the development of personalized treatment strategies. This study was supported by the National Natural Science Foundation of China (82172670, 81972858, 82202951 and 81773245), the Technology Innovation and Application Development Project of Chongqing (2023DBXM002 and CSTB2022TIAD-KPX0176 and CSTB2022NSCQ-MSX1356 and 2022yjgA06) and the Cultivation Program for Clinical Research Talents of Army Medical University (2018XLC1010 and 2019XQN10).
Deep learning-based diagnosis and survival prediction of patients with renal cell carcinoma from primary whole slide images

Siteng Chen,Xiyue Wang,Jun Zhang,Liren Jiang,Feng Gao,Jinxi Xiang,Sen Yang,Wei Yang,Junhua Zheng,Xiao Han

DOI: https://doi.org/10.1016/j.pathol.2024.05.012

IF: 5.335

2024-08-03

Pathology

Abstract:There is an urgent clinical demand to explore novel diagnostic and prognostic biomarkers for renal cell carcinoma (RCC). We proposed deep learning-based artificial intelligence strategies. The study included 1752 whole slide images from multiple centres. Based on the pixel-level of RCC segmentation, the diagnosis diagnostic model achieved an area under the receiver operating characteristic curve (AUC) of 0.977 (95% CI 0.969-0.984) in the external validation cohort. In addition, our diagnostic model exhibited excellent performance in the differential diagnosis of RCC from renal oncocytoma, which achieved an AUC of 0.951 (0.922-0.972). The graderisk for the recognition of high-grade tumour achieved AUCs of 0.840 (0.805-0.871) in the Cancer Genome Atlas (TCGA) cohort, 0.857 (0.813-0.894) in the Shanghai General Hospital (General) cohort, and 0.894 (0.842-0.933) in the Clinical Proteomic Tumor Analysis Consortium (CPTAC) cohort, for the recognition of high-grade tumour. The OSrisk for predicting 5-year survival status achieved an AUC of 0.784 (0.746-0.819) in the TCGA cohort, which was further verified in the independent general cohort and the CPTAC cohort, with AUCs of 0.774 (0.723-0.820) and 0.702 (0.632-0.765), respectively. Moreover, the competing-risk nomogram (CRN) showed its potential to be a prognostic indicator, with a hazard ratio (HR) of 5.664 (3.893-8.239, p<0.0001), outperforming other traditional clinical prognostic indicators. Kaplan-Meier survival analysis further illustrated that our CRN could significantly distinguish patients with high survival risk. Deep learning-based artificial intelligence could be a useful tool for clinicians to diagnose and predict the prognosis of RCC patients, thus improving the process of individualised treatment.
Predicting Colorectal Cancer Survival Using Time-to-Event Machine Learning: Retrospective Cohort Study

Xulin Yang,Hang Qiu,Liya Wang,Xiaodong Wang

DOI: https://doi.org/10.2196/44417

IF: 7.076

2023-10-27

Journal of Medical Internet Research

Abstract:Background: Machine learning (ML) methods have shown great potential in predicting colorectal cancer (CRC) survival. However, the ML models introduced thus far have mainly focused on binary outcomes and have not considered the time-to-event nature of this type of modeling. Objective: This study aims to evaluate the performance of ML approaches for modeling time-to-event survival data and develop transparent models for predicting CRC-specific survival. Methods: The data set used in this retrospective cohort study contains information on patients who were newly diagnosed with CRC between December 28, 2012, and December 27, 2019, at West China Hospital, Sichuan University. We assessed the performance of 6 representative ML models, including random survival forest (RSF), gradient boosting machine (GBM), DeepSurv, DeepHit, neural net-extended time-dependent Cox (or Cox-Time), and neural multitask logistic regression (N-MTLR) in predicting CRC-specific survival. Multiple imputation by chained equations method was applied to handle missing values in variables. Multivariable analysis and clinical experience were used to select significant features associated with CRC survival. Model performance was evaluated in stratified 5-fold cross-validation repeated 5 times by using the time-dependent concordance index, integrated Brier score, calibration curves, and decision curves. The SHapley Additive exPlanations method was applied to calculate feature importance. Results: A total of 2157 patients with CRC were included in this study. Among the 6 time-to-event ML models, the DeepHit model exhibited the best discriminative ability (time-dependent concordance index 0.789, 95% CI 0.779-0.799) and the RSF model produced better-calibrated survival estimates (integrated Brier score 0.096, 95% CI 0.094-0.099), but these are not statistically significant. Additionally, the RSF, GBM, DeepSurv, Cox-Time, and N-MTLR models have comparable predictive accuracy to the Cox Proportional Hazards model in terms of discrimination and calibration. The calibration curves showed that all the ML models exhibited good 5-year survival calibration. The decision curves for CRC-specific survival at 5 years showed that all the ML models, especially RSF, had higher net benefits than default strategies of treating all or no patients at a range of clinically reasonable risk thresholds. The SHapley Additive exPlanations method revealed that R0 resection, tumor-node-metastasis staging, and the number of positive lymph nodes were important factors for 5-year CRC-specific survival. Conclusions: This study showed the potential of applying time-to-event ML predictive algorithms to help predict CRC-specific survival. The RSF, GBM, Cox-Time, and N-MTLR algorithms could provide nonparametric alternatives to the Cox Proportional Hazards model in estimating the survival probability of patients with CRC. The transparent time-to-event ML models help clinicians to more accurately predict the survival rate for these patients and improve patient outcomes by enabling personalized treatment plans that are informed by explainable ML models.

health care sciences & services,medical informatics

Machine learning algorithms being an auxiliary tool to predict the overall survival of patients with renal cell carcinoma using the SEER database

Evaluation of Machine Learning Algorithms for the Prognosis of Breast Cancer from the Surveillance, Epidemiology, and End Results Database

Machine Learning Model for Predicting Postoperative Survival of Patients with Colorectal Cancer

Prediction of lung cancer patient survival via supervised machine learning classification techniques

Machine learning for predicting liver and/or lung metastasis in colorectal cancer: a retrospective study based on the SEER database

Development and validation of a machine learning model to predict the risk of lymph node metastasis in renal carcinoma

Application of Machine Learning Models to Predict Recurrence After Surgical Resection of Nonmetastatic Renal Cell Carcinoma

A Nomogram Predicting the Prognosis of Renal Cell Carcinoma Patients with Lung Metastases

AI predictive modeling of survival outcomes for renal cancer patients undergoing targeted therapy

Bone metastasis risk and prognosis assessment models for kidney cancer based on machine learning

Artificial intelligence for diagnosing and predicting survival of patients with renal cell carcinoma: Retrospective multi-center study

Predicting Overall Survival in Patients with Nonmetastatic Gastric Signet Ring Cell Carcinoma: A Machine Learning Approach.

Personalized three-year survival prediction and prognosis forecast by interpretable machine learning for pancreatic cancer patients: a population-based study and an external validation

Machine Learning Predict Survivals of Spinal and Pelvic Ewing's Sarcoma with the SEER Database.

Dynamic Predictive Models with Visualized Machine Learning for Assessing the Risk of Lung Metastasis in Kidney Cancer Patients

Leveraging SEER data through machine learning to predict distant lymph node metastasis and prognosticate outcomes in hepatocellular carcinoma patients

The Application and Comparison of Machine Learning Models for the Prediction of Breast Cancer Prognosis: Retrospective Cohort Study

Machine learning‐based prediction of survival prognosis in esophageal squamous cell carcinoma

Survival Prediction in Non-Small Cell Lung Cancer Patients: Performance Evaluation of Machine Learning Ensemble Models (Preprint)

Deep learning-based diagnosis and survival prediction of patients with renal cell carcinoma from primary whole slide images

Predicting Colorectal Cancer Survival Using Time-to-Event Machine Learning: Retrospective Cohort Study