Prediction of Microsatellite Instability of Colorectal Cancer Using Multi-Scale Pathological Images Based on Deep Learning

Ruifen Cao,Qingsong Gu,Dayu Tan,Pi-Jing Wei,Chunhou Zheng
DOI: https://doi.org/10.1109/bibm55620.2022.9995576
2022-01-01
Abstract:Immunotherapy is an excellent treatment option for many solid tumors, and the therapeutic effect has been proved in clinical. Microsatellite instability (MSI) has been an important predictive marker for response to immune checkpoint inhibitors for Colorectal cancer (CRC). CRC patients with high-level MSI can be provided immunotherapy and benefit from it. Some studies have attempted to predict MSI using pathological images based on deep learning, but the accuracy of the prediction model needs to be improved. In this study, considering that different scales of pathological images contain various levels of information, we propose a novel method, named MSIUMP, to predict microsatellite instability using multi-scale pathological images. We first predict the MSI of a patient based on deep learning model using different scale pathological images, and then integrate the results by ensemble learning to improve the generalization and robustness. In addition, a convolutional neural network model modified on the basis of EfficientNet is used to extract the information of patches from pathological images at different scales. Our method achieved the areas under the receiver operating characteristic curves (AUC) of 0.9096 in the internal test dataset TCGA-CRC and the AUC of 0.9619 in the external independent validation dataset PAIP2020. These results demonstrate the potential of our method as a prediction tool for microsatellite instability in colorectal cancer.
What problem does this paper attempt to address?