Abstract:In this paper, we propose a novel deep learning framework for anatomy segmentation and automatic landmark- ing. Specifically, we focus on the challenging problem of mandible segmentation from cone-beam computed tomography (CBCT) scans and identification of 9 anatomical landmarks of the mandible on the geodesic space. The overall approach employs three inter-related steps. In step 1, we propose a deep neu- ral network architecture with carefully designed regularization, and network hyper-parameters to perform image segmentation without the need for data augmentation and complex post- processing refinement. In step 2, we formulate the landmark localization problem directly on the geodesic space for sparsely- spaced anatomical landmarks. In step 3, we propose to use a long short-term memory (LSTM) network to identify closely- spaced landmarks, which is rather difficult to obtain using other standard detection networks. The proposed fully automated method showed superior efficacy compared to the state-of-the- art mandible segmentation and landmarking approaches in craniofacial anomalies and diseased states. We used a very challenging CBCT dataset of 50 patients with a high-degree of craniomaxillofacial (CMF) variability that is realistic in clinical practice. Complementary to the quantitative analysis, the qualitative visual inspection was conducted for distinct CBCT scans from 250 patients with high anatomical variability. We have also shown feasibility of the proposed work in an independent dataset from MICCAI Head-Neck Challenge (2015) achieving the state-of-the-art performance. Lastly, we present an in-depth analysis of the proposed deep networks with respect to the choice of hyper-parameters such as pooling and activation functions.

Deep Learning With Anatomical Priors: Imitating Enhanced Autoencoders In Latent Space For Improved Pelvic Bone Segmentation In MRI

DeU-Net 2.0: Enhanced deformable U-Net for 3D cardiac cine MRI segmentation

Semantic segmentation of microscopic neuroanatomical data by combining topological priors with encoder–decoder deep networks

An Auto-Encoder Strategy for Adaptive Image Segmentation

Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentation

Deep Sequential Segmentation of Organs in Volumetric Medical Scans

Atrous Residual Interconnected Encoder to Attention Decoder Framework for Vertebrae Segmentation via 3D Volumetric CT Images

Teaching AI the Anatomy Behind the Scan: Addressing Anatomical Flaws in Medical Image Segmentation with Learnable Prior

Semi-overcomplete convolutional auto-encoder embedding as shape priors for deep vessel segmentation

Deep Geodesic Learning for Segmentation and Anatomical Landmarking

Deep vessel segmentation with joint multi-prior encoding

DoubleU-Net++: Architecture with Exploit Multiscale Features for Vertebrae Segmentation

Fully Automated Pelvic Bone Segmentation in Multiparameteric MRI Using a 3D Convolutional Neural Network

Deep Learning Architectures for Automated Image Segmentation

Spatially Dependent U-Nets: Highly Accurate Architectures for Medical Imaging Segmentation

A Novel Deep Learning Pipeline for Vertebra Labeling and Segmentation of Spinal Computed Tomography Images

Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation

Knee Bone and Cartilage Segmentation Based on a 3D Deep Neural Network Using Adversarial Loss for Prior Shape Constraint

Auto-DenseUNet: Searchable neural network architecture for mass segmentation in 3D automated breast ultrasound

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

Deep Volumetric Shape Learning For Semantic Segmentation Of The Hip Joint From 3d Mr Images