Abstract:PURPOSE: It is of great significance to accurately identify the KRAS gene mutation status for patients in tumor prognosis and personalized treatment. Although the computer-aided diagnosis system based on deep learning has gotten all-round development, its performance still cannot meet the current clinical application requirements due to the inherent limitations of small-scale medical image data set and inaccurate lesion feature extraction. Therefore, our aim is to propose a deep learning model based on T2 MRI of colorectal cancer (CRC) patients to identify whether KRAS gene is mutated.METHODS: In this research, a multitask attentive model is proposed to identify KRAS gene mutations in patients, which is mainly composed of a segmentation subnetwork and an identification subnetwork. Specifically, at first, the features extracted by the encoder of segmentation model are used as guidance information to guide the two attention modules in the identification network for precise activation of the lesion area. Then the original image of the lesion and the segmentation result are concatenated for feature extraction. Finally, features extracted from the second step are combined with features activated by the attention modules to identify the gene mutation status. In this process, we introduce the interlayer loss function to encourage the similarity of the two subnetwork parameters and ensure that the key features are fully extracted to alleviate the overfitting problem caused by small data set to some extent.RESULTS: The proposed identification model is benchmarked primarily using 15-fold cross validation. Three hundred and eighty-two images from 36 clinical cases were used to test the model. For the identification of KRAS mutation status, the average accuracy is 89.95 <math><mo>±</mo></math> 1.23%, the average sensitivity is 89.29 <math><mo>±</mo></math> 1.79%, the average specificity is 90.53 <math><mo>±</mo></math> 2.45%, and the average area under the curve (AUC) is 95.73 <math><mo>±</mo></math> 0.52%. For segmentation of lesions, the average dice is 88.11 <math><mo>±</mo></math> 0.86%.CONCLUSIONS: We developed a novel deep learning-based model to identify the KRAS status in CRC. We demonstrated the excellent properties of the proposed identification through comparison with ground truth gene mutation status of 36 clinical cases. And all these results show that the novel method has great potential for clinical application.

Integrating image and gene-data with a semi-supervised attention model for prediction of KRAS gene mutation status in non-small cell lung cancer

A multitask dual‐stream attention network for the identification of KRAS mutation in colorectal cancer

SAMA: A Self-and-Mutual Attention Network for Accurate Recurrence Prediction of Non-Small Cell Lung Cancer Using Genetic and CT Data

Multimodality Attention-Guided 3-D Detection of Nonsmall Cell Lung Cancer in 18 F-FDG PET/CT Images

Hybrid Deep Multi-Task Learning Radiomics Approach for Predicting EGFR Mutation Status of Non-Small Cell Lung Cancer in CT Images.

Predicting BRCA mutation and stratifying targeted therapy response using multimodal learning: a multicenter study

Deep Learning to Predict EGFR Mutation and PD-L1 Expression Status in Non-Small-Cell Lung Cancer on Computed Tomography Images

A Disentangled Representation-Based Multimodal Fusion Framework Integrating Pathomics and Radiomics for KRAS Mutation Detection in Colorectal Cancer

CT-based non-invasive identification of the most common gene mutation status in patients with non-small cell lung cancer

Next Generation Radiogenomics Sequencing for Prediction of EGFR and KRAS Mutation Status in NSCLC Patients Using Multimodal Imaging and Machine Learning Approaches

Deep neural network for the prediction of KRAS, NRAS, and BRAF genotypes in left-sided colorectal cancer based on histopathologic images

Cross-modality Attention-based Multimodal Fusion for Non-small Cell Lung Cancer (NSCLC) Patient Survival Prediction

Predictive radiogenomics modeling of EGFR mutation status in lung cancer

Noninvasive KRAS mutation estimation in colorectal cancer using a deep learning method based on CT imaging

Machine Learning-Based Radiomics Signatures for EGFR and KRAS Mutations Prediction in Non-Small-Cell Lung Cancer

Noninvasive KRAS mutation estimation in colorectal cancer using a deep learning method based on routine CT imaging

Deep learning approach for predicting lymph node metastasis in non-small cell lung cancer by fusing image–gene data

CHNet: A multi-task global-local Collaborative Hybrid Network for KRAS mutation status prediction in colorectal cancer

Ability of 18F-FDG Positron Emission Tomography Radiomics and Machine Learning in Predicting KRAS Mutation Status in Therapy-Naive Lung Adenocarcinoma

Reliable Gene Mutation Prediction in Clear Cell Renal Cell Carcinoma through Multi-classifier Multi-objective Radiogenomics Model

Sub-region Aware Retrieval-Based Network with Multimodal Prior Knowledge Guidance for Microvascular Invasion Prediction in PET/CT Imaging