Abstract:Craniomaxillofacial (CMF) surgery always relies on accurate preoperative planning to assist surgeons, and automatically generating bone structures and digitizing landmarks for CMF preoperative planning is crucial. Since the soft and hard tissues of the CMF regions possess complicated attachment, segmenting the CMF bones and detecting the CMF landmarks are challenging problems. In this study, we proposed a semantic segmentation network to segment the maxilla, mandible, zygoma, zygomatic arch, and frontal bones. Then, we obtained the minimum bounding box around the CMF bones. After cropping, we used the top-down heatmap landmark detection network, similar to the segmentation module, to identify 18 CMF landmarks from the cropping patch. In addition, an unbiased heatmap encoding method was proposed to generate actual landmark coordinates in the heatmap. To overcome quantization effects in the heatmap-based landmark detection networks, the distribution-prior coordinate representation of medical landmarks (DCRML) was proposed to utilize the prior distribution of the encoding heatmap, approximating the accurate landmark coordinates in heatmap decoding by Taylor's theorem. The encoding and decoding method can easily contribute to other existing landmark detection frameworks based on heatmaps; consequently, these approaches can readily benefit without changing model structure. We used prior segmentation knowledge to enhance the semantic information around the landmarks, increasing landmark detection accuracy. The proposed framework was evaluated by 100 healthy persons and 86 patients from multicenter cooperation. The mean Dice score of our proposed segmentation network achieved over 88 %; in particular, the mandible accuracy was approximately 95%. The mean error of landmarks was 1.84 $\pm$ 1.32 mm.

Multiregion Segmentation Based on Compact Shape Prior

Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation.

Mesh Segmentation with Concavity-Aware Fields

Part-to-Surface Mesh Segmentation for Mechanical Models Based on Multi-Stage Clustering

Optimal Multi-Object Segmentation with Novel Gradient Vector Flow Based Shape Priors

A novel segmentation algorithm for complex 3D mesh model in computer vision.

Point-Based Geometric Deformable Models for Medical Image Segmentation

Segmentation Based on Shape Prior and Graph Model Optimization

User-controllable Mesh Segmentation Using Shape Harmonic Signature

Short Communication to SMI 2011: CAD mesh model segmentation by clustering

A hybrid framework for 3D medical image segmentation

A Hybrid Level Set with Semantic Shape Constraint for Object Segmentation.

A Geometric Approach to Joint 2D Region-Based Segmentation and 3D Pose Estimation Using a 3D Shape Prior

Reduced Set Density Estimator For Object Segmentation Based On Shape Probabilistic Representation

Robust Human Body Segmentation Based on Part Appearance and Spatial Constraint

Craniomaxillofacial Bone Segmentation and Landmark Detection Using Semantic Segmentation Networks and an Unbiased Heatmap.

SEG-MAT: 3D Shape Segmentation Using Medial Axis Transform

Database-guided simultaneous multi-slice 3d segmentation for volumetric data

MCMC Shape Sampling for Image Segmentation with Nonparametric Shape Priors

Robust Global Minimization of Active Contour Model for Multi-Object Medical Image Segmentation

DCSM 2.0: Deep Conditional Shape Models for Data Efficient Segmentation