Abstract:Organ delineation is crucial to diagnosis and therapy, while it is also labor-intensive and observer-dependent. Dual energy CT (DECT) provides additional image contrast than conventional single energy CT (SECT), which may facilitate automatic organ segmentation. This work aims to develop an automatic multi-organ segmentation approach using deep learning for head-and-neck region on DECT. We proposed a mask scoring regional convolutional neural network (R-CNN) where comprehensive features are firstly learnt from two independent pyramid networks and are then combined via deep attention strategy to highlight the informative ones extracted from both two channels of low and high energy CT. To perform multi-organ segmentation and avoid misclassification, a mask scoring subnetwork was integrated into the Mask R-CNN framework to build the correlation between the class of potential detected organ's region-of-interest (ROI) and the shape of that organ's segmentation within that ROI. We evaluated our model on DECT images from 127 head-and-neck cancer patients (66 training, 61 testing) with manual contours of 19 organs as training target and ground truth. For large- and mid-sized organs such as brain and parotid, the proposed method successfully achieved average Dice similarity coefficient (DSC) larger than 0.8. For small-sized organs with very low contrast such as chiasm, cochlea, lens and optic nerves, the DSCs ranged between around 0.5 and 0.8. With the proposed method, using DECT images outperforms using SECT in almost all 19 organs with statistical significance in DSC (p<0.05). Meanwhile, by using the DECT, the proposed method is also significantly superior to a recently developed FCN-based method in most of organs in terms of DSC and the 95th percentile Hausdorff distance. Quantitative results demonstrated the feasibility of the proposed method, the superiority of using DECT to SECT, and the advantage of the proposed R-CNN over FCN on the head-and-neck patient study. The proposed method has the potential to facilitate the current head-and-neck cancer radiation therapy workflow in treatment planning.

CT image organ segmentation method based on convolutional neural network multi-dimensional fusion

Fundus blood vessel segmentation method based on branch attention and multi-model fusion

Multi-Organ Segmentation Based on Convolutional Neural Network and Random Walk for CT Image

Incorporating the hybrid deformable model for improving the performance of abdominal CT segmentation via multi-scale feature fusion network

Improving Generalization Capability of Multiorgan Segmentation Models Using Dual-Energy CT

Medical Image Segmentation Based on Multi-Modal Convolutional Neural Network: Study on Image Fusion Schemes

A Multiorgan Segmentation Model for CT Volumes Via Full Convolution-Deconvolution Network.

Multiple Organ Localization in CT Image Using Triple-Branch Fully Convolutional Networks.

Dual encoder network with transformer-CNN for multi-organ segmentation

Multi-feature fusion 3D-CNN for tooth segmentation

A Novel Hybrid Convolutional Neural Network for Accurate Organ Segmentation in 3D Head and Neck CT Images

Tumor co-segmentation in PET/CT using multi-modality fully convolutional neural network

Head and neck multi-organ segmentation on dual-energy CT using dual pyramid convolutional neural networks

An application of cascaded 3D fully convolutional networks for medical image segmentation

Hybrid Attention Mechanism of Feature Fusion for Medical Image Segmentation

Label-efficient Multi-organ Segmentation Method with Diffusion Model

Automatic Segmentation of Head-Neck Organs by Multi-mode CNNs for Radiation Therapy

Multi-organ segmentation network for abdominal CT images based on spatial attention and deformable convolution

SequentialSegNet: Combination with Sequential Feature for Multi-Organ Segmentation

DS-MSFF-Net: Dual-path Self-Attention Multi-Scale Feature Fusion Network for CT Image Segmentation

Automatic Abdominal Multi-Organ Segmentation Using Deep Convolutional Neural Network and Time-Implicit Level Sets