Investigation of deep learning model for predicting immune checkpoint inhibitor treatment efficacy on contrast-enhanced computed tomography images of hepatocellular carcinoma

Yasuhiko Nakao,Takahito Nishihara,Ryu Sasaki,Masanori Fukushima,Satoshi Miuma,Hisamitsu Miyaaki,Yuko Akazawa,Kazuhiko Nakao
DOI: https://doi.org/10.1038/s41598-024-57078-y
IF: 4.6
2024-03-20
Scientific Reports
Abstract:Although the use of immune checkpoint inhibitors (ICIs)-targeted agents for unresectable hepatocellular carcinoma (HCC) is promising, individual response variability exists. Therefore, we developed an artificial intelligence (AI)-based model to predict treatment efficacy using pre-ICIs contrast-enhanced computed tomography (CT) imaging characteristics. We evaluated the efficacy of atezolizumab and bevacizumab in 43 patients at the Nagasaki University Hospital from 2020 to 2022 using the modified Response Evaluation Criteria in Solid Tumors. A total of 197 Progressive Disease (PD), 271 Partial Response (PR), and 342 Stable Disease (SD) contrast CT images of HCC were used for training. We used ResNet-18 as the Convolutional Neural Network (CNN) model and YOLOv5, YOLOv7, YOLOv8 as the You Only Look Once (YOLO) model with precision-recall curves and class activation maps (CAMs) for diagnostic performance evaluation and model interpretation, respectively. The 3D t-distributed Stochastic Neighbor Embedding was used for image feature analysis. The YOLOv7 model demonstrated Precision 53.7%, Recall 100%, F1 score 69.8%, mAP@0.5 99.5% for PD, providing accurate and clinically versatile predictions by identifying decisive points. The ResNet-18 model had Precision 100% and Recall 100% for PD. However, the CAMs sites did not align with the tumors, suggesting the CNN model is not predicting that a given CT slice is PD, PR, or SD, but that it accurately predicts Individual Patient's CT slices. Preparing substantial training data for tumor drug effect prediction models is challenging compared to general tumor diagnosis models; hence, large-scale validation using an efficient YOLO model is warranted.
multidisciplinary sciences
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: **Using deep - learning models to predict the efficacy of immune checkpoint inhibitors (ICIs) in the treatment of hepatocellular carcinoma (HCC)**. Specifically, the authors focus on: 1. **Individual response variability**: Although immune checkpoint inhibitors (ICIs) have shown potential in the treatment of unresectable hepatocellular carcinoma (HCC), there are significant differences in the responses of different patients to the treatment. Therefore, a method is needed to predict in advance which patients will have a good response to ICI treatment. 2. **Development of a prediction model based on CT images**: The authors attempt to develop an artificial intelligence (AI) - based model that uses enhanced CT image features to predict the efficacy of ICI treatment. This helps doctors identify patients who are likely to have a good response to ICI treatment at an early stage and evaluate the treatment effect, so as to adjust the treatment plan in a timely manner. 3. **Improving the accuracy of clinical decision - making**: By using deep - learning models (such as ResNet - 18 and YOLO series models) in combination with CT image data, the treatment effect can be predicted more accurately, helping doctors make more informed treatment decisions. ### Method overview To achieve the above goals, the authors carried out the following work: - **Data collection**: From 2020 to 2022, CT image data of 43 unresectable HCC patients who received ICI treatment were collected. - **Model selection and training**: - Use ResNet - 18 as a convolutional neural network (CNN) model. - Use YOLOv5, YOLOv7 and YOLOv8 as real - time object detection models. - Evaluate model performance through Precision - Recall Curves and Class Activation Maps (CAMs). - **Result analysis**: - The YOLOv7 model performed well in predicting disease progression (PD), with a precision of 53.7%, a recall rate of 100%, an F1 score of 69.8%, and an mAP@0.5 of 99.5%. - The ResNet - 18 model also achieved 100% precision and recall rate when predicting disease progression (PD), but the CAMs results showed that its area of interest was not always consistent with the tumor area. ### Conclusion The research results show that the YOLO model has higher accuracy and clinical applicability in predicting the efficacy of ICI treatment, can accurately locate key areas, and provide valuable decision - support for doctors. However, preparing a sufficient number of high - quality labeled data remains a challenge, and larger - scale verification and improvement are needed in the future. Through these efforts, researchers hope that AI models can better assist doctors in making treatment decisions in future clinical practice and improve the treatment effect of hepatocellular carcinoma patients.