Abstract:Background Multimodality positron emission tomography/computed tomography (PET/CT) imaging combines the anatomical information of CT with the functional information of PET. In the diagnosis and treatment of many cancers, such as non-small cell lung cancer (NSCLC), PET/CT imaging allows more accurate delineation of tumor or involved lymph nodes for radiation planning. Purpose In this paper, we propose a hybrid regional network method of automatically segmenting lung tumors from PET/CT images. Methods The hybrid regional network architecture synthesizes the functional and anatomical information from the two image modalities, whereas the mask regional convolutional neural network (R-CNN) and scoring fine-tune the regional location and quality of the output segmentation. This model consists of five major subnetworks, that is, a dual feature representation network (DFRN), a regional proposal network (RPN), a specific tumor-wise R-CNN, a mask-Net, and a score head. Given a PET/CT image as inputs, the DFRN extracts feature maps from the PET and CT images. Then, the RPN and R-CNN work together to localize lung tumors and reduce the image size and feature map size by removing irrelevant regions. The mask-Net is used to segment tumor within a volume-of-interest (VOI) with a score head evaluating the segmentation performed by the mask-Net. Finally, the segmented tumor within the VOI was mapped back to the volumetric coordinate system based on the location information derived via the RPN and R-CNN. We trained, validated, and tested the proposed neural network using 100 PET/CT images of patients with NSCLC. A fivefold cross-validation study was performed. The segmentation was evaluated with two indicators: (1) multiple metrics, including the Dice similarity coefficient, Jacard, 95th percentile Hausdorff distance, mean surface distance (MSD), residual mean square distance, and center-of-mass distance; (2) Bland-Altman analysis and volumetric Pearson correlation analysis. Results In fivefold cross-validation, this method achieved Dice and MSD of 0.84 +/- 0.15 and 1.38 +/- 2.2 mm, respectively. A new PET/CT can be segmented in 1 s by this model. External validation on The Cancer Imaging Archive dataset (63 PET/CT images) indicates that the proposed model has superior performance compared to other methods. Conclusion The proposed method shows great promise to automatically delineate NSCLC tumors on PET/CT images, thereby allowing for a more streamlined clinical workflow that is faster and reduces physician effort.

ASE-Net: A tumor segmentation method based on image pseudo enhancement and adaptive-scale attention supervision module

Tri-PANet: Triplanar Ensemble Network with Parallelly Aggregating Global and Local Information for Brain Tumor Segmentation

ISA-Net: Improved spatial attention network for PET-CT tumor segmentation

A Spatial Squeeze and Multimodal Feature Fusion Attention Network for Multiple Tumor Segmentation from PET–CT Volumes

MRLA-Net: A Tumor Segmentation Network Embedded with a Multiple Receptive-Field Lesion Attention Module in PET-CT Images.

A Hard Segmentation Network Guided by Soft Segmentation for Tumor Segmentation on PET/CT Images.

MSRA-Net: Tumor segmentation network based on Multi-scale Residual Attention

Attention-enhanced multiscale feature fusion network for pancreas and tumor segmentation

3D PET/CT tumor segmentation based on nnU-Net with GCN refinement

Automated Lung Tumor Delineation on Positron Emission Tomography/computed Tomography Via a Hybrid Regional Network

Tumor co-segmentation in PET/CT using multi-modality fully convolutional neural network

DPAFNet: A Residual Dual-Path Attention-Fusion Convolutional Neural Network for Multimodal Brain Tumor Segmentation

Automatic Tumor Segmentation by Means of Deep Convolutional U-Net with Pre-Trained Encoder in PET Images.

Joint segmentation of tumors in 3D PET-CT images with a network fusing multi-view and multi-modal information

MFCNet: A multi-modal fusion and calibration networks for 3D pancreas tumor segmentation on PET-CT images

Multimodal Spatial Attention Module for Targeting Multimodal PET-CT Lung Tumor Segmentation

3D Reconstruction-Oriented Fully Automatic Multi-Modal Tumor Segmentation by Dual Attention-Guided VNet

Multi-modal co-learning with attention mechanism for head and neck tumor segmentation on 18FDG PET-CT

MMCA-NET: A Multimodal Cross Attention Transformer Network for Nasopharyngeal Carcinoma Tumor Segmentation Based on a Total-Body PET/CT System

Whole-body tumor segmentation of 18F -FDG PET/CT using a cascaded and ensembled convolutional neural networks

Modality-Specific Segmentation Network for Lung Tumor Segmentation in PET-CT Images