Abstract:Purpose: This study aims to compare the performance of radiomics features and deep learning (DL) features in predicting the prognostic of stage II colorectal cancer (CRC) patients, and fuse these two types of imaging features of primary lesion and peripheral lymph nodes (LNs) to improve the prediction performance. Materials and Methods: We first collected 230 patients (170 in the training set; 60 in the testing set) with clinicopathologically confirmed stage II CRC. Then, we built two CT radiomics models by using primary tumor and LN image features, respectively. The radiomics model development process included tumor or LN segmentation, feature extraction and selection, synthetic minority oversampling technique (SMOTE) oversampling, and support vector machine classifier training/testing. In order to improve the radiomics model performance, we used an information fusion method to build a fusion radiomics model by combining tumor and LN image features. Meanwhile, we applied a transfer learning method to build a deep convolutional neural network (CNN) model to predict the prognosis of CRC patients. Finally, we fused the prediction scores generated by radiomics model and CNN model to improve the prognosis prediction performance. Results: The DFS and OS prediction AUC values generated by fusion model improved to 0.76±0.08 (95% CI: [0.57, 0.89]) and 0.91±0.05 (95% CI: [0.77, 0.97]), which were significantly higher than the AUC values generated by the models using CT radiomics feature and deep image feature individually. Applying survival analysis method, the DFS fusion model and OS fusion model yielded a concordance index (C-index) value of 0.73 (95% CI: [0.56, 0.89]), and 0.9 (95% CI: [0.83, 0.97]), respectively. Conclusion: The present study developed an artificial intelligence (AI) model to predict the prognosis of stage II CRC by radiomics and DL analysis of primary lesion and peripheral LNs in CT scan that can assist clinical screening of high-risk patients with poor prognosis to achieve precision medicine. Funding Statement: National Natural Science Foundation of China (Grant No. 81971687). Declaration of Interests: None of the investigators has any affiliations or financial involvement that conflicts with the material presented in this report. Ethics Approval Statement: Our Institutional Review Board (Fudan University Shanghai Cancer Center Medical Ethics Committee) approved this study and waived the need for informed consent from patients.

Multi-Size Deep Learning Based Preoperative Computed Tomography Signature for Prognosis Prediction of Colorectal Cancer

Exploring prognostic biomarkers in pathological images of colorectal cancer patients via deep learning

Diagnosis and Survival Prediction of Colorectal Cancer Using Deep Learning from the Histopathological HE Images

Predicting bone metastasis-free survival in non-small cell lung cancer from preoperative CT via deep learning

MTSC2: Multi-task Survival Prediction on Colorectal CT Images with Clinical Information

Development and Validation of a Deep Learning CT Signature to Predict Survival and Chemotherapy Benefit in Gastric Cancer

Deep learning to identify a gene signature associated with molecular subtypes that predicts prognosis in colorectal cancer.

A Metabolism-Related Radiomics Signature For Predicting The Prognosis Of Colorectal Cancer

Non-invasive prediction of microsatellite instability in colorectal cancer by a genetic algorithm–enhanced artificial neural network–based CT radiomics signature

Individualized Prediction of Colorectal Cancer Metastasis Using a Radiogenomics Approach

Deep-learning features based on F18 fluorodeoxyglucose positron emission tomography/computed tomography (18F-FDG PET/CT) to predict preoperative colorectal cancer lymph node metastasis

Preoperative Multidetector-Row Computed Tomography-Guided Prognostic Prediction for Disease-Free Survival: A Multicenter Study in Gastric Cancer

Deep learning-extracted CT imaging phenotypes predict response to total resection in colorectal cancer

Special issue "The advance of solid tumor research in China": Prognosis prediction for stage II colorectal cancer by fusing computed tomography radiomics and deep-learning features of primary lesions and peripheral lymph nodes

Predicting postoperative prognosis in clear cell renal cell carcinoma using a multiphase CT-based deep learning model

Preoperative Prediction of Lymph Node Metastasis in Colorectal Cancer with Deep Learning

Prognosis Prediction for Stage II Colorectal Cancer by Fusing CT Radiomics and Deep Learning Features of Primary Lesion and Peripheral Lymph Nodes

Deep Learning Features Improve the Performance of a Radiomics Signature for Predicting KRAS Status in Patients with Colorectal Cancer

Deep Learning Signature Based on Staging CT for Preoperative Prediction of Sentinel Lymph Node Metastasis in Breast Cancer

A CT-based multitask deep learning model for predicting tumor stroma ratio and treatment outcomes in patients with colorectal cancer: a multicenter cohort study

A computed tomography-based multitask deep learning model for predicting tumour stroma ratio and treatment outcomes in patients with colorectal cancer: a multicentre cohort study