Abstract:Background: Predicting the neoadjuvant chemoradiotherapy (nCRT) response for patient with locally advanced rectal cancer (LARC) would facilitate therapeutic decisions. Yet, the approach to predict the treatment response before nCRT remains challenging. Here, we develop a multicenter deep learning model based on the pretreatment whole slide image (WSI) of hematoxylin and eosin (H&E) stained biopsy to distinguish the pathological complete response (pCR) from the LARC patients.Methods: Consecutive patients with WSI of endoscopic biopsy H&E-stained slides were included from two hospitals as a training cohort (n = 303) and a validation cohort (n = 154), respectively. Tissue regions of each WSI of H&E-stained biopsy slides were automatically segmented and subjected to extract deep features to construct a deep signature by a VGG-16 convolutional neural network model. A prediction model combining the deep signature with clinicopathologic predictors was developed and validated to identify the pCR group. Receiver operating characteristic (ROC) curves and decision curve analysis (DCA) was used to calculate the predictive performance.Findings: The combined model showed good discrimination of the pCR group in two cohorts [the average area under ROC (95% confidence interval): 0.87 (0.83-0.91) in the training cohort, and 0.79 (0.71-0.86) in the independent validation cohort]. Besides, DCA proved that the combined model was clinically valuable.Interpretation: The deep learning model based on biopsy WSI indicates that it might offer a simple preoperative tool to predicts nCRT treatment response for LARC patients.Funding Information: This study was funded by research grants from the National Natural Science Foundation of China [82001986], National Science Fund for Distinguished Young Scholars [81925023], National Key Research and Development Program of China [2017YFC1309102], the Applied Basic Research Projects of Yunnan Province, China [2019FE001-083 and 2018FE001-065], Yunnan digitalization, development and application of biotic resource [202002AA100007].Declaration of Interests: The authors declare that there are no conflicts of interest.Ethics Approval Statement: The ethics committees of the Sixth Affiliated Hospital of Sun Yat-sen University (SYSU6) and Yunnan Cancer Hospital (YNCH) both approved the multicenter retrospective study. The board waived the requirement for informed consent because of the study’s retrospective nature. All data in the study were de-identified and anonymized.

Deep learning model for predicting treatment response for patients with rectal cancer using 3D medical imaging.

Machine learning for prediction of chemoradiation therapy response in rectal cancer using pre-treatment and mid-radiation multi-parametric MRI

Predicting treatment response for the safe non-operative management of patients with rectal cancer using an MRI-based deep-learning model.

Deep Learning Model for Predicting the Pathological Complete Response to Neoadjuvant Chemoradiotherapy of Locally Advanced Rectal Cancer

Predicting Rectal Cancer Response to Neoadjuvant Chemoradiotherapy Using Deep Learning of Diffusion Kurtosis MRI

Machine learning in predicting pathological complete response to neoadjuvant chemoradiotherapy in rectal cancer using MRI: a systematic review and meta-analysis

Deep Learning for Prediction of Neoadjuvant Chemoradiotherapy Response in Locally Advanced Rectal Cancer: A Retrospective Multi-Cohort Pathomics Study

Deep Learning‐assisted Magnetic Resonance Imaging Prediction of Tumor Response to Chemotherapy in Patients with Colorectal Liver Metastases

Radiomics Signature Based on Support Vector Machines for the Prediction of Pathological Complete Response to Neoadjuvant Chemoradiotherapy in Locally Advanced Rectal Cancer

A Deep Learning Model to Predict the Response to Neoadjuvant Chemoradiotherapy by the Pretreatment Apparent Diffusion Coefficient Images of Locally Advanced Rectal Cancer

Deep learning-based imaging reconstruction for MRI after neoadjuvant chemoradiotherapy for rectal cancer: effects on image quality and assessment of treatment response

Prediction of Neoadjuvant Chemoradiotherapy Response in Rectal Cancer Patients Using Harmonized Radiomics of Multcenter 18F-FDG-PET Image

MRI-Based Radiomics Predicts Tumor Response to Neoadjuvant Chemoradiotherapy in Locally Advanced Rectal Cancer

Deep learning model based on endoscopic images predicting treatment response in locally advanced rectal cancer undergo neoadjuvant chemoradiotherapy: a multicenter study

Treatment response prediction of neoadjuvant chemotherapy for rectal cancer by deep learning of colonoscopy images

Radiomics for the Prediction of Pathological Complete Response to Neoadjuvant Chemoradiation in Locally Advanced Rectal Cancer: A Prospective Observational Trial.

MRI Radiomics Model Predicts Pathologic Complete Response of Rectal Cancer Following Chemoradiotherapy.

Evaluation of Neoadjuvant Chemoradiotherapy Response in Rectal Cancer Using MR Images and Deep Learning Neural Networks

Multiparametric MRI-Based Deep Learning Models for Preoperative Prediction of Tumor Deposits in Rectal Cancer and Prognostic Outcome

Pathologic Complete Response Prediction after Neoadjuvant Chemoradiation Therapy for Rectal Cancer Using Radiomics and Deep Embedding Network of MRI

A Pipeline for Predicting the Treatment Response of Neoadjuvant Chemoradiotherapy for Locally Advanced Rectal Cancer Using Single MRI Modality: Combining Deep Segmentation Network and Radiomics Analysis Based on “Suspicious Region”