Abstract:Background Over the recent years, machine learning methods have been increasingly explored in cancer prognosis because of the appearance of improved machine learning algorithms. These algorithms can use censored data for modeling, such as support vector machines for survival analysis and random survival forest (RSF). However, it is still debated whether traditional (Cox proportional hazard regression) or machine learning-based prognostic models have better predictive performance. Objective This study aimed to compare the performance of breast cancer prognostic prediction models based on machine learning and Cox regression. Methods This retrospective cohort study included all patients diagnosed with breast cancer and subsequently hospitalized in Fudan University Shanghai Cancer Center between January 1, 2008, and December 31, 2016. After all exclusions, a total of 22,176 cases with 21 features were eligible for model development. The data set was randomly split into a training set (15,523 cases, 70%) and a test set (6653 cases, 30%) for developing 4 models and predicting the overall survival of patients diagnosed with breast cancer. The discriminative ability of models was evaluated by the concordance index (C-index), the time-dependent area under the curve, and D-index; the calibration ability of models was evaluated by the Brier score. Results The RSF model revealed the best discriminative performance among the 4 models with 3-year, 5-year, and 10-year time-dependent area under the curve of 0.857, 0.838, and 0.781, a D-index of 7.643 (95% CI 6.542, 8.930) and a C-index of 0.827 (95% CI 0.809, 0.845). The statistical difference of the C-index was tested, and the RSF model significantly outperformed the Cox-EN (elastic net) model (C-index 0.816, 95% CI 0.796, 0.836; P=.01), the Cox model (C-index 0.814, 95% CI 0.794, 0.835; P=.003), and the support vector machine model (C-index 0.812, 95% CI 0.793, 0.832; P<.001). The 4 models’ 3-year, 5-year, and 10-year Brier scores were very close, ranging from 0.027 to 0.094 and less than 0.1, which meant all models had good calibration. In the context of feature importance, elastic net and RSF both indicated that TNM staging, neoadjuvant therapy, number of lymph node metastases, age, and tumor diameter were the top 5 important features for predicting the prognosis of breast cancer. A final online tool was developed to predict the overall survival of patients with breast cancer. Conclusions The RSF model slightly outperformed the other models on discriminative ability, revealing the potential of the RSF method as an effective approach to building prognostic prediction models in the context of survival analysis.

Prognosis and risk factor assessment of patients with advanced lung cancer with low socioeconomic status: model development and validation

Evaluation of Machine Learning Algorithms for the Prognosis of Breast Cancer from the Surveillance, Epidemiology, and End Results Database

Development and validation of a machine learning model for survival risk stratification after esophageal cancer surgery

Development and validation of a survival prediction model for patients with advanced non-small cell lung cancer based on LASSO regression

The Application and Comparison of Machine Learning Models for the Prediction of Breast Cancer Prognosis: Retrospective Cohort Study

Predicting lung cancer survival prognosis based on the conditional survival bayesian network

Development of Lung Cancer Risk Prediction Machine Learning Models for Equitable Learning Health System: Retrospective Study

Development and validation of reassigned CEA, CYFRA21-1 and NSE-based models for lung cancer diagnosis and prognosis prediction

Pulmonary function test-related prognostic models in non-small cell lung cancer patients receiving neoadjuvant chemoimmunotherapy

Laboratory blood parameters and machine learning for the prognosis of esophageal squamous cell carcinoma

Identifying and assessing a prognostic model based on disulfidptosis-related genes: implications for immune microenvironment and tumor biology in lung adenocarcinoma

Construction and Validation of Early Warning Model of Lung Cancer Based on Machine Learning: A Retrospective Study

Machine learning‐based prediction of survival prognosis in esophageal squamous cell carcinoma

Risk prediction model for lung cancer incorporating metabolic markers: Development and internal validation in a Chinese population

Predicting the risk of lung cancer using machine learning: A large study based on UK Biobank

A prognostic framework for predicting lung signet ring cell carcinoma via a machine learning based cox proportional hazard model

Novel Machine Learning Algorithm in Risk Prediction Model for Pan-Cancer Risk: Application in a Large Prospective Cohort

Risk Prediction Models for Lung Cancer: Perspectives and Dissemination

A large cohort study identifying a novel prognosis prediction model for lung adenocarcinoma through machine learning strategies

Prediction of lung cancer patient survival via supervised machine learning classification techniques

Construction of a risk prediction model for lung infection after chemotherapy in lung cancer patients based on the machine learning algorithm