Abstract:Background Over the recent years, machine learning methods have been increasingly explored in cancer prognosis because of the appearance of improved machine learning algorithms. These algorithms can use censored data for modeling, such as support vector machines for survival analysis and random survival forest (RSF). However, it is still debated whether traditional (Cox proportional hazard regression) or machine learning-based prognostic models have better predictive performance. Objective This study aimed to compare the performance of breast cancer prognostic prediction models based on machine learning and Cox regression. Methods This retrospective cohort study included all patients diagnosed with breast cancer and subsequently hospitalized in Fudan University Shanghai Cancer Center between January 1, 2008, and December 31, 2016. After all exclusions, a total of 22,176 cases with 21 features were eligible for model development. The data set was randomly split into a training set (15,523 cases, 70%) and a test set (6653 cases, 30%) for developing 4 models and predicting the overall survival of patients diagnosed with breast cancer. The discriminative ability of models was evaluated by the concordance index (C-index), the time-dependent area under the curve, and D-index; the calibration ability of models was evaluated by the Brier score. Results The RSF model revealed the best discriminative performance among the 4 models with 3-year, 5-year, and 10-year time-dependent area under the curve of 0.857, 0.838, and 0.781, a D-index of 7.643 (95% CI 6.542, 8.930) and a C-index of 0.827 (95% CI 0.809, 0.845). The statistical difference of the C-index was tested, and the RSF model significantly outperformed the Cox-EN (elastic net) model (C-index 0.816, 95% CI 0.796, 0.836; P=.01), the Cox model (C-index 0.814, 95% CI 0.794, 0.835; P=.003), and the support vector machine model (C-index 0.812, 95% CI 0.793, 0.832; P<.001). The 4 models’ 3-year, 5-year, and 10-year Brier scores were very close, ranging from 0.027 to 0.094 and less than 0.1, which meant all models had good calibration. In the context of feature importance, elastic net and RSF both indicated that TNM staging, neoadjuvant therapy, number of lymph node metastases, age, and tumor diameter were the top 5 important features for predicting the prognosis of breast cancer. A final online tool was developed to predict the overall survival of patients with breast cancer. Conclusions The RSF model slightly outperformed the other models on discriminative ability, revealing the potential of the RSF method as an effective approach to building prognostic prediction models in the context of survival analysis.

Novel models by machine learning to predict prognosis of breast cancer brain metastases

Evaluation of Machine Learning Algorithms for the Prognosis of Breast Cancer from the Surveillance, Epidemiology, and End Results Database

A Clinical Prediction Model for the Presence of Brain Metastases from Colorectal Cancer

A novel quantitative prognostic model for initially diagnosed non-small cell lung cancer with brain metastases

Machine learning-based prediction model for distant metastasis of breast cancer

Development and External Validation of a Prediction Model for Brain Metastases in Patients with Metastatic Breast Cancer

Machine-Learning-Aided Prediction of Brain Metastases Development in Non-Small-Cell Lung Cancers

Prediction model for ocular metastasis of breast cancer: machine learning model development and interpretation study

Potential of radiomics analysis and machine learning for predicting brain metastasis in newly diagnosed lung cancer patients

Establishment of a prognostic risk prediction modelfor non-small cell lung cancer patients with brainmetastases: a retrospective study

Prediction of treatment response in patients with brain metastasis receiving stereotactic radiosurgery based on pre-treatment multimodal MRI radiomics and clinical risk factors: A machine learning model

Deciphering breast cancer prognosis: a novel machine learning-driven model for vascular mimicry signature prediction

Machine Learning Enables Accurate and Rapid Prediction of Active Molecules Against Breast Cancer Cells

Development and validation of an artificial intelligence model for predicting de novo distant bone metastasis in breast cancer: a dual-center study

Predicting chemo‐brain in breast cancer survivors using multiple MRI features and machine‐learning

The Application and Comparison of Machine Learning Models for the Prediction of Breast Cancer Prognosis: Retrospective Cohort Study

Machine learning to predict the cancer-specific mortality of patients with primary non-metastatic invasive breast cancer

Comparison and Modification of Survival Predicting System for Breast Cancer Patients with Bone Metastases

Development and validation of a five-gene model to predict postoperative brain metastasis in operable lung adenocarcinoma

A novel model based on lipid metabolism-related genes associated with immune microenvironment predicts metastasis of breast cancer

Cancer Metastasis Prediction and Genomic Biomarker Identification through Machine Learning and eXplainable Artificial Intelligence in Breast Cancer Research