Abstract:PurposeAccurate 3D image segmentation is a crucial step in radiation therapy planning of head and neck tumors. These segmentation results are currently obtained by manual outlining of tissues, which is a tedious and time-consuming procedure. Automatic segmentation provides an alternative solution, which, however, is often difficult for small tissues (i.e., chiasm and optic nerves in head and neck CT images) because of their small volumes and highly diverse appearance/shape information. In this work, we propose to interleave multiple 3D Convolutional Neural Networks (3D-CNNs) to attain automatic segmentation of small tissues in head and neck CT images. MethodA 3D-CNN was designed to segment each structure of interest. To make full use of the image appearance information, multiscale patches are extracted to describe the center voxel under consideration and then input to the CNN architecture. Next, as neighboring tissues are often highly related in the physiological and anatomical perspectives, we interleave the CNNs designated for the individual tissues. In this way, the tentative segmentation result of a specific tissue can contribute to refine the segmentations of other neighboring tissues. Finally, as more CNNs are interleaved and cascaded, a complex network of CNNs can be derived, such that all tissues can be jointly segmented and iteratively refined. ResultOur method was validated on a set of 48 CT images, obtained from the Medical Image Computing and Computer Assisted Intervention (MICCAI) Challenge 2015. The Dice coefficient (DC) and the 95% Hausdorff Distance (95HD) are computed to measure the accuracy of the segmentation results. The proposed method achieves higher segmentation accuracy (with the average DC: 0.580.17 for optic chiasm, and 0.71 +/- 0.08 for optic nerve; 95HD: 2.81 +/- 1.56mm for optic chiasm, and 2.23 +/- 0.90mm for optic nerve) than the MICCAI challenge winner (with the average DC: 0.38 for optic chiasm, and 0.68 for optic nerve; 95HD: 3.48 for optic chiasm, and 2.48 for optic nerve). ConclusionAn accurate and automatic segmentation method has been proposed for small tissues in head and neck CT images, which is important for the planning of radiotherapy.

An interactive image segmentation method for the anatomical structures of the main olfactory bulb with micro-level resolution

Deep Learning-Based Segmentation of Post-Mortem Human's Olfactory Bulb Structures in X-ray Phase-Contrast Tomography

Visualizing the human olfactory projection and ancillary structures in a 3D reconstruction

Computerized three dimensional reconstruction of the insect olfactory nerves

High Precision Vibration Sectioning for 3D Imaging of the Whole Central Nervous System.

Deep residual contextual and subpixel convolution network for automated neuronal structure segmentation in micro-connectomics

Quantitative analysis of blood vessels and nerve cells based on three-dimensional microscopic imaging of the whole mouse brain

DeepBrainSeg: Automated Brain Region Segmentation for Micro-Optical Images with a Convolutional Neural Network

Boosting Multilabel Semantic Segmentation for Somata and Vessels in Mouse Brain

A modular hierarchical approach to 3D electron microscopy image segmentation.

An automated three-dimensional detection and segmentation method for touching cells by integrating concave points clustering and random walker algorithm.

Deep-learning-based Whole-Brain Imaging at Single-Neuron Resolution

Automated segmentation of brain tissue and white matter in cryosection images from Chinese visible human dataset

Automated neuropil segmentation of fluorescent images for Drosophila brains

Automated Brain Region Segmentation for Single Cell Resolution Histological Images Based on Markov Random Field.

Interleaved 3D-Cnns for Joint Segmentation of Small-Volume Structures in Head and Neck CT Images.

Automatic segmentation of the olfactory bulbs in MRI

Micro-Optical Sectioning Tomography to Obtain a High-Resolution Atlas of the Mouse Brain

A Convenient All-Cell Optical Imaging Method Compatible with Serial SEM for Brain Mapping

Optical Multilayer Interference Tomography Compatible with Tape-Based Serial SEM for Mesoscale Neuroanatomy

Opportunities and challenges for mouse brainwide neuroanatomical connectivity with micrometer resolution