Abstract:Summary Background Accurate tumour response prediction to targeted therapy allows for personalised conversion therapy for patients with unresectable colorectal cancer liver metastases (CRLM). In this study, we aimed to develop and validate a multi-modal deep learning model to predict the efficacy of bevacizumab in patients with initially unresectable CRLM using baseline PET/CT, clinical data, and colonoscopy biopsy specimens. Methods In this multicentre cohort study, we retrospectively collected data of 307 patients with CRLM from the BECOME study ( NCT01972490 ) (Zhongshan Hospital of Fudan University, Shanghai) and two independent Chinese cohorts (internal validation cohort from January 1, 2018 to December 31, 2018 at Zhongshan Hospital of Fudan University; external validation cohort from January 1, 2020 to December 31, 2020 at Zhongshan Hospital—Xiamen, Shanghai, and the First Hospital of Wenzhou Medical University, Wenzhou). The main inclusion criteria were that patients with CRLM had pre-treatment PET/CT images as well as colonoscopy specimens. After extracting PET/CT features with deep neural networks (DNN) and selecting related clinical factors using LASSO analysis, a random forest classifier was built as the Deep Radiomics Bevacizumab efficacy predicting model (DERBY). Furthermore, by combining histopathological biomarkers into DERBY, we established DERBY + . The performance of model was evaluated using area under the curve (AUC), sensitivity, specificity, positive predictive value, and negative predictive value. Findings DERBY achieved promising performance in predicting bevacizumab sensitivity with an AUC of 0.77 and 95% confidence interval (CI) [0.67–0.87]. After combining histopathological features, we developed DERBY + , which had more robust accuracy for predicting tumour response in external validation cohort (AUC 0.83 and 95% CI [0.75–0.92], sensitivity 80.4%, specificity 76.8%). DERBY + also had prognostic value: the responders had longer progression-free survival (median progression-free survival: 9.6 vs 6.3 months, p = 0.002) and overall survival (median overall survival: 27.6 vs 18.5 months, p = 0.010) than non-responders. Interpretation This multi-modal deep radiomics model, using PET/CT, clinical data and histopathological data, was able to identify patients with bevacizumab-sensitive CRLM, providing a favourable approach for precise patient treatment. To further validate and explore the clinical impact of this work, future prospective studies with larger patient cohorts are warranted. Funding The National Natural Science Foundation of China ; Fujian Provincial Health Commission Project ; Xiamen Science and Technology Agency Program ; Clinical Research Plan of SHDC ; Shanghai Science and Technology Committee Project ; Clinical Research Plan of SHDC ; Zhejiang Provincial Natural Science Foundation of China ; and National Science Foundation of Xiamen .

Deep learning‐based radiomics predicts response to chemotherapy in colorectal liver metastases

Machine learning for prediction of chemoradiation therapy response in rectal cancer using pre-treatment and mid-radiation multi-parametric MRI

Deep Learning‐assisted Magnetic Resonance Imaging Prediction of Tumor Response to Chemotherapy in Patients with Colorectal Liver Metastases

Deep learning radiomic analysis of DCE-MRI combined with clinical characteristics predicts pathological complete response to neoadjuvant chemotherapy in breast cancer

Predicting response to neoadjuvant chemotherapy for colorectal liver metastasis using deep learning on prechemotherapy cross‐sectional imaging

Deep learning radiomics-based prediction of distant metastasis in patients with locally advanced rectal cancer after neoadjuvant chemoradiotherapy: A multicentre study

Deep learning-based radiomic features for improving neoadjuvant chemoradiation response prediction in locally advanced rectal cancer

Deep learning to estimate response of concurrent chemoradiotherapy in non-small-cell lung carcinoma

A Deep Learning Radiomics Nomogram to Predict Response to Neoadjuvant Chemotherapy for Locally Advanced Cervical Cancer: A Two-Center Study

Deep learning for the prediction of early on-treatment response in metastatic colorectal cancer from serial medical imaging

Deep learning for predicting major pathological response to neoadjuvant chemoimmunotherapy in non-small cell lung cancer: A multicentre study

Non-invasive prediction for pathologic complete response to neoadjuvant chemoimmunotherapy in lung cancer using CT-based deep learning: a multicenter study

Ultrasound-based deep learning radiomics in the assessment of pathological complete response to neoadjuvant chemotherapy in locally advanced breast cancer

Deep radiomics-based fusion model for prediction of bevacizumab treatment response and outcome in patients with colorectal cancer liver metastases: a multicentre cohort study

Dynamic radiomics for predicting the efficacy of antiangiogenic therapy in colorectal liver metastases

Predicting Rectal Cancer Response to Neoadjuvant Chemoradiotherapy Using Deep Learning of Diffusion Kurtosis MRI

A Deep Learning Model to Predict the Response to Neoadjuvant Chemoradiotherapy by the Pretreatment Apparent Diffusion Coefficient Images of Locally Advanced Rectal Cancer

Deep Learning for Prediction of Neoadjuvant Chemoradiotherapy Response in Locally Advanced Rectal Cancer: A Retrospective Multi-Cohort Pathomics Study

Deep learning radiomics based on contrast enhanced MRI for preoperatively predicting early recurrence in hepatocellular carcinoma after curative resection

Deep learning radiomics of ultrasonography can predict response to neoadjuvant chemotherapy in breast cancer at an early stage of treatment: a prospective study

Deep Learning Predicts Lung Cancer Treatment Response from Serial Medical Imaging