Identification and risk classification of thymic epithelial tumors using 3D computed tomography images and deep learning models

Ye Sung Moon,Byunggeon Park,Jongmin Park,Thao Thi Ho,Jae-Kwang Lim,Sanghun Choi

DOI: https://doi.org/10.1016/j.bspc.2024.106473

IF: 5.1

2024-05-26

Biomedical Signal Processing and Control

Abstract:Thymic epithelial tumor (TET) is the most common neoplasm of the anterior mediastinum, accounting for approximately 47 % of all anterior mediastinal tumors. Early identification and risk stratification of patients with TET are beneficial for efficient intervention, but identifying subjects at high risk is challenging and time-consuming. This study proposes a deep-learning (DL) framework that combines the automatic segmentation of lung lesions with the classification of high-risk cases of TET. The model was trained, validated, and tested using computed tomography images of 125 patients with TET. Our method comprises two steps: 1) automatic segmentation of TET and comparison of the performance of 3D U-Net, 3D Res U-Net, 3D Dense U-Net, 3D Wide U-Net, and 3D U-Net++ models; 2) identification of high-risk TET cases using pretrained DL models (3D ResNet50, 3D SE ResNext50, 3D DenseNet121, and 3D VGG19) with transfer learning. The hyperparameters for segmentation and classification were determined using Bayesian optimization. Among the abovementioned 3D U-Net-based methods, 3D U-Net++ showed the best segmentation performance on the test set. Among the four classification models, ResNet50 performed the best on the test set. We also used a gradient-weighted class activation map to visualize the classification of risk groups in convolutional neural networks (CNNs), emphasizing sensitive features in the learning process. This study is the first to integrate automated segmentation of TETs with the identification of high-risk cases. The results demonstrate that CNN DL techniques can be used for the diagnosis and classification of risk groups in patients with TET.

engineering, biomedical