Abstract:Rationale and objectives: To develop and validate multimodal deep-learning models based on clinical variables, multiparametric MRI (mp-MRI) and hematoxylin and eosin (HE) stained pathology slides for predicting microsatellite instability (MSI) status in rectal cancer patients. Materials and methods: A total of 467 surgically confirmed rectal cancer patients from three centers were included in this study. Patients from center 1 were randomly divided into a training set (242 patients) and an internal validation (invad) set (105 patients) in a 7:3 ratio. Patients from centers 2 and 3 (120 patients) were included in an external validation (exvad) set. HE and immunohistochemistry (IHC) staining were analyzed, and MSI status was confirmed by IHC staining. Independent predictive factors were identified through univariate and multivariate analyses based on clinical evaluations and were used to construct a clinical model. Deep learning with ResNet-101 was applied to preoperative MRI (T2WI, DWI, and contrast-enhanced T1WI sequences) and postoperative HE-stained images to calculate deep-learning radiomics score (DLRS) and deep-learning pathomics score (DLPS), respectively, and to DLRS and DLPS models. Receiver operating characteristic (ROC) curves were plotted, and the area under the curve (AUC) was used to evaluate and compare the predictive performance of each model. Results: Among all rectal cancer patients, 82 (17.6%) had MSI. Long diameter (LD) and pathological T stage (pT) were identified as independent predictors and were used to construct the clinical model. After undergoing deep learning and feature selection, a final set of 30 radiomics features and 30 pathomics features were selected to construct the DLRS and DLPS models. A nomogram combining the clinical model, DLRS, and DLPS was created through weighted linear combination. The AUC values of the clinical model for predicting MSI were 0.714, 0.639, and 0.697 in the training, invad, and exvad sets, respectively. The AUCs of DLPS and DLRS ranged from 0.896 to 0.961 across the training, invad, and exvad sets. The nomogram achieved AUC values of 0.987, 0.987, and 0.974, with sensitivities of 1.0, 0.963, and 1.0 and specificities of 0.919, 0.949, and 0.867 in the training, invad, and exvad sets, respectively. The nomogram outperformed the other three models in all sets, with DeLong test results indicating superior predictive performance in the training set. Conclusion: The nomogram, incorporating clinical data, mp-MRI, and HE staining, effectively reflects tumor heterogeneity by integrating multimodal data. This model demonstrates high predictive accuracy and generalizability in predicting MSI status in rectal cancer patients.

A Deep Learning Model Based on MRI and Clinical Factors Facilitates Noninvasive Evaluation of KRAS Mutation in Rectal Cancer

Noninvasive KRAS mutation estimation in colorectal cancer using a deep learning method based on CT imaging

Noninvasive KRAS mutation estimation in colorectal cancer using a deep learning method based on routine CT imaging

Development and Validation of a MRI-based Radiomics Signature for Prediction of KRAS Mutation in Rectal Cancer

Feasibility of MRI Radiomics for Predicting KRAS Mutation in Rectal Cancer

An MRI Deep Learning Model Predicts Outcome in Rectal Cancer

MRI Radiomics Signature as a Potential Biomarker for Predicting KRAS Status in Locally Advanced Rectal Cancer Patients

KRAS Status Predicted by Pretreatment MRI Radiomics Was Associated with Lung Metastasis in Locally Advanced Rectal Cancer Patients.

A multitask dual‐stream attention network for the identification of KRAS mutation in colorectal cancer

A Multi-Task Dual-Stream Attention Network for the Identification of KRAS Mutation in Colorectal Cancer.

Prediction of Kirsten rat sarcoma (KRAS) mutation in rectal cancer with amide proton transfer-weighted magnetic resonance imaging

Comparative Evaluation of the Value of Quantitative Parameters of Dual-energy CT and MRI for KRAS Mutation in Rectal Cancer

Predicting Kirsten Rat Sarcoma Virus Gene Mutation Status in Patients With Colorectal Cancer by Radiomics Models Based on Multiphasic CT

Current status and quality of radiomic studies for predicting KRAS mutations in Colorectal cancer patients: a systematic review and meta‐analysis

Deep Learning‐Based Multiparametric MRI Model for Preoperative T‐Stage in Rectal Cancer

Multi-branch Cross Attention Model for Prediction of KRAS Mutation in Rectal Cancer with T2-Weighted MRI

Spatial-Frequency Dual-Branch Attention Model For Determining Kras Mutation Status In Colorectal Cancer With T2-Weighted Mri

MRI-Based Deep Learning Analysis Can Predict Microsatellite Instability in Rectal Cancer

Deep Learning Algorithm‑Based MRI Radiomics and Pathomics for Predicting Microsatellite Instability Status in Rectal Cancer: A Multicenter Study

Comparable Performance of Deep Learning–Based to Manual-Based Tumor Segmentation in KRAS/NRAS/BRAF Mutation Prediction With MR-Based Radiomics in Rectal Cancer

Multiparametric MRI-Based Deep Learning Models for Preoperative Prediction of Tumor Deposits in Rectal Cancer and Prognostic Outcome