Abstract:Background Multimodality positron emission tomography/computed tomography (PET/CT) imaging combines the anatomical information of CT with the functional information of PET. In the diagnosis and treatment of many cancers, such as non-small cell lung cancer (NSCLC), PET/CT imaging allows more accurate delineation of tumor or involved lymph nodes for radiation planning. Purpose In this paper, we propose a hybrid regional network method of automatically segmenting lung tumors from PET/CT images. Methods The hybrid regional network architecture synthesizes the functional and anatomical information from the two image modalities, whereas the mask regional convolutional neural network (R-CNN) and scoring fine-tune the regional location and quality of the output segmentation. This model consists of five major subnetworks, that is, a dual feature representation network (DFRN), a regional proposal network (RPN), a specific tumor-wise R-CNN, a mask-Net, and a score head. Given a PET/CT image as inputs, the DFRN extracts feature maps from the PET and CT images. Then, the RPN and R-CNN work together to localize lung tumors and reduce the image size and feature map size by removing irrelevant regions. The mask-Net is used to segment tumor within a volume-of-interest (VOI) with a score head evaluating the segmentation performed by the mask-Net. Finally, the segmented tumor within the VOI was mapped back to the volumetric coordinate system based on the location information derived via the RPN and R-CNN. We trained, validated, and tested the proposed neural network using 100 PET/CT images of patients with NSCLC. A fivefold cross-validation study was performed. The segmentation was evaluated with two indicators: (1) multiple metrics, including the Dice similarity coefficient, Jacard, 95th percentile Hausdorff distance, mean surface distance (MSD), residual mean square distance, and center-of-mass distance; (2) Bland-Altman analysis and volumetric Pearson correlation analysis. Results In fivefold cross-validation, this method achieved Dice and MSD of 0.84 +/- 0.15 and 1.38 +/- 2.2 mm, respectively. A new PET/CT can be segmented in 1 s by this model. External validation on The Cancer Imaging Archive dataset (63 PET/CT images) indicates that the proposed model has superior performance compared to other methods. Conclusion The proposed method shows great promise to automatically delineate NSCLC tumors on PET/CT images, thereby allowing for a more streamlined clinical workflow that is faster and reduces physician effort.

A Multi-Task Convolutional Neural Network for Lesion Region Segmentation and Classification of Non-Small Cell Lung Carcinoma

MM-DCNet: A Multi-Scale and Multi-MOdality Dynamic Convolutional Network for Lung Cancer Subtypes Classification

Multi-task Learning-Based Histologic Subtype Classification of Non-Small Cell Lung Cancer.

CC-DCNet: Dynamic Convolutional Neural Network with Contrastive Constraints for Identifying Lung Cancer Subtypes on Multi-modality Images

Enhanced NSCLC Subtyping and Staging Through Attention-Augmented Multi-Task Deep Learning: A Novel Diagnostic Tool

One-step algorithm for fast-track localization and multi-category classification of histological subtypes in lung cancer

A multi-task deep learning model for EGFR genotyping prediction and GTV segmentation of brain metastasis

Histological Subtype Classification of Non-Small Cell Lung Cancer with Radiomics and 3D Convolutional Neural Networks

Precise and automated lung cancer cell classification using deep neural network with multiscale features and model distillation

Lung Nodule Malignancy Prediction Using Multi-Task Convolutional Neural Network

End-to-End Multi-Task Learning for Lung Nodule Segmentation and Diagnosis

Harnessing Deep Learning for Accurate Pathological Assessment of Brain Tumor Cell Types

Joint Lymphoma Lesion Segmentation and Prognosis Prediction from Baseline FDG-PET Images Via Multitask Convolutional Neural Networks

A Deep Multi-Task Network to Learn Tumor Pathological Representations for Lymph Node Metastasis Prediction.

Improving HER2-Positive Breast Cancer Targeted Therapy Prediction Using Multimsnet: A Multi-Scale Pathological Image-Based Approach

Multimodal Non-Small Cell Lung Cancer Classification Using Convolutional Neural Networks

A Novel Network Based on Densely Connected Fully Convolutional Networks for Segmentation of Lung Tumors on Multi-Modal MR Images

Combining Multi-Scale Feature Fusion with Multi-Attribute Grading, a CNN Model for Benign and Malignant Classification of Pulmonary Nodules.

Multi-path Convolutional Neural Network for Lung Cancer Detection

Joint segmentation and classification of skin lesions via a multi-task learning convolutional neural network

Automated Lung Tumor Delineation on Positron Emission Tomography/computed Tomography Via a Hybrid Regional Network