Abstract:Background Multimodality positron emission tomography/computed tomography (PET/CT) imaging combines the anatomical information of CT with the functional information of PET. In the diagnosis and treatment of many cancers, such as non-small cell lung cancer (NSCLC), PET/CT imaging allows more accurate delineation of tumor or involved lymph nodes for radiation planning. Purpose In this paper, we propose a hybrid regional network method of automatically segmenting lung tumors from PET/CT images. Methods The hybrid regional network architecture synthesizes the functional and anatomical information from the two image modalities, whereas the mask regional convolutional neural network (R-CNN) and scoring fine-tune the regional location and quality of the output segmentation. This model consists of five major subnetworks, that is, a dual feature representation network (DFRN), a regional proposal network (RPN), a specific tumor-wise R-CNN, a mask-Net, and a score head. Given a PET/CT image as inputs, the DFRN extracts feature maps from the PET and CT images. Then, the RPN and R-CNN work together to localize lung tumors and reduce the image size and feature map size by removing irrelevant regions. The mask-Net is used to segment tumor within a volume-of-interest (VOI) with a score head evaluating the segmentation performed by the mask-Net. Finally, the segmented tumor within the VOI was mapped back to the volumetric coordinate system based on the location information derived via the RPN and R-CNN. We trained, validated, and tested the proposed neural network using 100 PET/CT images of patients with NSCLC. A fivefold cross-validation study was performed. The segmentation was evaluated with two indicators: (1) multiple metrics, including the Dice similarity coefficient, Jacard, 95th percentile Hausdorff distance, mean surface distance (MSD), residual mean square distance, and center-of-mass distance; (2) Bland-Altman analysis and volumetric Pearson correlation analysis. Results In fivefold cross-validation, this method achieved Dice and MSD of 0.84 +/- 0.15 and 1.38 +/- 2.2 mm, respectively. A new PET/CT can be segmented in 1 s by this model. External validation on The Cancer Imaging Archive dataset (63 PET/CT images) indicates that the proposed model has superior performance compared to other methods. Conclusion The proposed method shows great promise to automatically delineate NSCLC tumors on PET/CT images, thereby allowing for a more streamlined clinical workflow that is faster and reduces physician effort.

Machine learning methods for accurate delineation of tumors in PET images

Automated Delineation of Nasopharynx Gross Tumor Volume for Nasopharyngeal Carcinoma by Plain CT Combining Contrast-Enhanced CT Using Deep Learning

Deep Learning-Based Segmentation of Tumors in PET/CT Volumes: Benchmark of Different Architectures and Training Strategies

A Novel PET Tumor Delineation Method Based on Adaptive Region-Growing and Dual-Front Active Contours

Automated Lung Tumor Delineation on Positron Emission Tomography/computed Tomography Via a Hybrid Regional Network

Efficient model-informed co-segmentation of tumors on PET/CT driven by clustering and classification information

Deep learning for automatic tumour segmentation in PET/CT images of patients with head and neck cancers

Weakly Supervised Tumor Detection in PET Using Class Response for Treatment Outcome Prediction

Adaptive Kernelized Evidential Clustering for Automatic 3D Tumor Segmentation in FDG–PET Images

A physics-guided modular deep-learning based automated framework for tumor segmentation in PET

A Physics-Guided Modular Deep-Learning Based Automated Framework for Tumor Segmentation in PET Images

Insight on automated lesion delineation methods for PET data

Improved 3D tumour definition and quantification of uptake in simulated lung tumours using deep learning

PET-guided delineation of radiation therapy treatment volumes: a survey of image segmentation techniques

A Bayesian approach to tissue-fraction estimation for oncological PET segmentation

Comparison of deep learning networks for fully automated head and neck tumor delineation on multi-centric PET/CT images

Deep learning automates bidimensional and volumetric tumor burden measurement from MRI in pre- and post-operative glioblastoma patients

Comprehensive framework for evaluation of deep neural networks in detection and quantification of lymphoma from PET/CT images: clinical insights, pitfalls, and observer agreement analyses

Deep Learning-Based Brain Tumor Bed Segmentation for Dynamic Magnetic Resonance Perfusion Imaging

Exploring feature-based approaches in PET images for predicting cancer treatment outcomes

Deep learning with uncertainty estimation for automatic tumor segmentation in PET/CT of head and neck cancers: impact of model complexity, image processing and augmentation