Abstract:Background Over the recent years, machine learning methods have been increasingly explored in cancer prognosis because of the appearance of improved machine learning algorithms. These algorithms can use censored data for modeling, such as support vector machines for survival analysis and random survival forest (RSF). However, it is still debated whether traditional (Cox proportional hazard regression) or machine learning-based prognostic models have better predictive performance. Objective This study aimed to compare the performance of breast cancer prognostic prediction models based on machine learning and Cox regression. Methods This retrospective cohort study included all patients diagnosed with breast cancer and subsequently hospitalized in Fudan University Shanghai Cancer Center between January 1, 2008, and December 31, 2016. After all exclusions, a total of 22,176 cases with 21 features were eligible for model development. The data set was randomly split into a training set (15,523 cases, 70%) and a test set (6653 cases, 30%) for developing 4 models and predicting the overall survival of patients diagnosed with breast cancer. The discriminative ability of models was evaluated by the concordance index (C-index), the time-dependent area under the curve, and D-index; the calibration ability of models was evaluated by the Brier score. Results The RSF model revealed the best discriminative performance among the 4 models with 3-year, 5-year, and 10-year time-dependent area under the curve of 0.857, 0.838, and 0.781, a D-index of 7.643 (95% CI 6.542, 8.930) and a C-index of 0.827 (95% CI 0.809, 0.845). The statistical difference of the C-index was tested, and the RSF model significantly outperformed the Cox-EN (elastic net) model (C-index 0.816, 95% CI 0.796, 0.836; P=.01), the Cox model (C-index 0.814, 95% CI 0.794, 0.835; P=.003), and the support vector machine model (C-index 0.812, 95% CI 0.793, 0.832; P<.001). The 4 models’ 3-year, 5-year, and 10-year Brier scores were very close, ranging from 0.027 to 0.094 and less than 0.1, which meant all models had good calibration. In the context of feature importance, elastic net and RSF both indicated that TNM staging, neoadjuvant therapy, number of lymph node metastases, age, and tumor diameter were the top 5 important features for predicting the prognosis of breast cancer. A final online tool was developed to predict the overall survival of patients with breast cancer. Conclusions The RSF model slightly outperformed the other models on discriminative ability, revealing the potential of the RSF method as an effective approach to building prognostic prediction models in the context of survival analysis.

Prediction of Prognosis in Patients with Systemic Sclerosis Based on a Machine-Learning Model

A Multi-Predictor Model to Predict Risk of Scleroderma Renal Crisis in Systemic Sclerosis: a Multicentre, Retrospective, Cohort Study.

Prediction of progressive fibrosing interstitial lung disease in patients with systemic sclerosis: insight from the CRDC cohort study

A Machine Learning Application to Predict Early Lung Involvement in Scleroderma: A Feasibility Evaluation

Development of a multivariable prediction model for progression of systemic sclerosis-associated interstitial lung disease

Improving Cardiovascular Risk Prediction Through Machine Learning Modelling of Irregularly Repeated Electronic Health Records

Preliminary nomogram model for predicting irreversible organ damage of patients with systemic sclerosis

Predicting the Outcome of Patients with Aneurysmal Subarachnoid Hemorrhage: A Machine-Learning-Guided Scorecard

Prediction of prognosis in elderly patients with sepsis based on machine learning (random survival forest)

Predicting post-lung transplant survival in systemic sclerosis using CT-derived features from preoperative chest CT scans

The Application and Comparison of Machine Learning Models for the Prediction of Breast Cancer Prognosis: Retrospective Cohort Study

Early Prediction of Mortality Risk among Patients with Severe COVID-19, Using Machine Learning

Development of Clinical Decision Models for the Prediction of Systemic Lupus Erythematosus and Sjogren’s Syndrome Overlap

Dynamic Prognosis Model for Predicting Survival in Severe and Critically Ill COVID-19 Patients Using Machine Learning

Interpretable Machine Learning for Early Prediction of Prognosis in Sepsis: A Discovery and Validation Study

Prediction of Progression of Interstitial Lung Disease in Patients with Systemic Sclerosis: the SPAR Model.

Nomogram and Machine Learning Models Predict 1-Year Mortality Risk in Patients With Sepsis-Induced Cardiorenal Syndrome

Early Warning Models Using Machine Learning to Predict Sepsis-Associated Chronic Critical Illness: A Study Based on the Medical Information Mart for Intensive Care Database

The development of a prediction model based on random survival forest for the prognosis of non- Hodgkin lymphoma: A prospective cohort study in China

Development and validation of a machine learning model to predict prognosis in liver failure patients treated with non-bioartificial liver support system

Development and validation of a survival prediction model for patients with advanced non-small cell lung cancer based on LASSO regression