Abstract:PurposeAccurate 3D image segmentation is a crucial step in radiation therapy planning of head and neck tumors. These segmentation results are currently obtained by manual outlining of tissues, which is a tedious and time-consuming procedure. Automatic segmentation provides an alternative solution, which, however, is often difficult for small tissues (i.e., chiasm and optic nerves in head and neck CT images) because of their small volumes and highly diverse appearance/shape information. In this work, we propose to interleave multiple 3D Convolutional Neural Networks (3D-CNNs) to attain automatic segmentation of small tissues in head and neck CT images. MethodA 3D-CNN was designed to segment each structure of interest. To make full use of the image appearance information, multiscale patches are extracted to describe the center voxel under consideration and then input to the CNN architecture. Next, as neighboring tissues are often highly related in the physiological and anatomical perspectives, we interleave the CNNs designated for the individual tissues. In this way, the tentative segmentation result of a specific tissue can contribute to refine the segmentations of other neighboring tissues. Finally, as more CNNs are interleaved and cascaded, a complex network of CNNs can be derived, such that all tissues can be jointly segmented and iteratively refined. ResultOur method was validated on a set of 48 CT images, obtained from the Medical Image Computing and Computer Assisted Intervention (MICCAI) Challenge 2015. The Dice coefficient (DC) and the 95% Hausdorff Distance (95HD) are computed to measure the accuracy of the segmentation results. The proposed method achieves higher segmentation accuracy (with the average DC: 0.580.17 for optic chiasm, and 0.71 +/- 0.08 for optic nerve; 95HD: 2.81 +/- 1.56mm for optic chiasm, and 2.23 +/- 0.90mm for optic nerve) than the MICCAI challenge winner (with the average DC: 0.38 for optic chiasm, and 0.68 for optic nerve; 95HD: 3.48 for optic chiasm, and 2.48 for optic nerve). ConclusionAn accurate and automatic segmentation method has been proposed for small tissues in head and neck CT images, which is important for the planning of radiotherapy.

Segmentation of Brain Internal Structures Automatically Using Non-rigid Registration with Simultaneous Intensity and Geometric Match

Automatic Head MRI Segmentation Combining FCM and VBM

Simultaneous Intracranial Artery Tracing and Segmentation from Magnetic Resonance Angiography by Joint Optimization from Multiplanar Reformation

Integrated 3d flow-based multi-atlas brain structure segmentation.

Simultaneous reconstruction and segmentation of MRI image by manifold learning

Self-adapting Segmentation for Brain Tissue

Automatic Segmentation of Non-tumor Tissues in Glioma MR Brain Images Using Deformable Registration with Partial Convolutional Networks

3D MRI Image Super-Resolution for Brain Combining Rigid and Large Diffeomorphic Registration

Anatomically Constrained and Attention-Guided Deep Feature Fusion for Joint Segmentation and Deformable Medical Image Registration.

A Registration-Based Propagation Framework for Automatic Whole Heart Segmentation of Cardiac MRI

Salient Feature Volume and Its Application in Brain MRI Image Registration.

Interactive Medical Image Sequences Segmentation Based on Non-Rigid Registration

Interleaved 3D-Cnns for Joint Segmentation of Small-Volume Structures in Head and Neck CT Images.

Exclusive Independent Probability Estimation using Deep 3D Fully Convolutional DenseNets: Application to IsoIntense Infant Brain MRI Segmentation

Deep coupled registration and segmentation of multimodal whole-brain images

Improving segmentation reliability of multi-scanner brain images using a generative adversarial network

A Multi-channel Network with Image Retrieval for Accurate Brain Tissue Segmentation

An Atlas-Based Segmentation Propagation Framework Using Locally Affine Registration - Application to Automatic Whole Heart Segmentation

Topology-based nonlocal fuzzy segmentation of brain MR image with inhomogeneous and partial volume intensity.

A Framework of Automatic Brain Tumor Segmentation Method Based on Information Fusion of Structural and Functional MRI Signals

Symmetric Diffeomorphic Image Registration with Multi-Label Segmentation Masks