Abstract:Craniomaxillofacial (CMF) surgery always relies on accurate preoperative planning to assist surgeons, and automatically generating bone structures and digitizing landmarks for CMF preoperative planning is crucial. Since the soft and hard tissues of the CMF regions possess complicated attachment, segmenting the CMF bones and detecting the CMF landmarks are challenging problems. In this study, we proposed a semantic segmentation network to segment the maxilla, mandible, zygoma, zygomatic arch, and frontal bones. Then, we obtained the minimum bounding box around the CMF bones. After cropping, we used the top-down heatmap landmark detection network, similar to the segmentation module, to identify 18 CMF landmarks from the cropping patch. In addition, an unbiased heatmap encoding method was proposed to generate actual landmark coordinates in the heatmap. To overcome quantization effects in the heatmap-based landmark detection networks, the distribution-prior coordinate representation of medical landmarks (DCRML) was proposed to utilize the prior distribution of the encoding heatmap, approximating the accurate landmark coordinates in heatmap decoding by Taylor's theorem. The encoding and decoding method can easily contribute to other existing landmark detection frameworks based on heatmaps; consequently, these approaches can readily benefit without changing model structure. We used prior segmentation knowledge to enhance the semantic information around the landmarks, increasing landmark detection accuracy. The proposed framework was evaluated by 100 healthy persons and 86 patients from multicenter cooperation. The mean Dice score of our proposed segmentation network achieved over 88 %; in particular, the mandible accuracy was approximately 95%. The mean error of landmarks was 1.84 $\pm$ 1.32 mm.

Automatic Detection of Anatomical Landmarks on Geometric Mesh Data Using Deep Semantic Segmentation

3D Human Landmark Detection and Segmentation with Semantic Knowledge

Automatic Location and Semantic Labeling of Landmarks on 3D Human Body Models

Deep Geodesic Learning for Segmentation and Anatomical Landmarking

Anatomic-landmark Detection Using Graphical Context Modelling.

DenseSeg: Joint Learning for Semantic Segmentation and Landmark Detection Using Dense Image-to-Shape Representation

Automated Anatomical Landmark Detection Ondistal Femur Surface Using Convolutional Neural Network

Automatic landmark detection for high resolution non-rigid 3D faces based on geometric information

Learning-based local-to-global landmark annotation for automatic 3D cephalometry

Craniomaxillofacial Bone Segmentation and Landmark Detection Using Semantic Segmentation Networks and an Unbiased Heatmap.

An Automated Method of 3D Facial Soft Tissue Landmark Prediction Based on Object Detection and Deep Learning

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images

Detecting Anatomical Landmarks From Limited Medical Imaging Data Using Two-Stage Task-Oriented Deep Neural Networks

Semi-supervised Anatomical Landmark Detection via Shape-regulated Self-training

Robust Multi-scale Anatomical Landmark Detection in Incomplete 3D-CT Data

Anatomical Landmarks Annotation on 2D Lateral Cephalograms with Channel Attention

Semi-automatic Cephalometric Landmark Detection on X-ray Images Using Deep Learning Method

Automatic location scheme of anatomical landmarks in 3D head MRI based on the scale attention hourglass network

A Coarse-to-Fine Approach for 3D Facial Landmarking by Using Deep Feature Fusion

Fully automated landmarking and facial segmentation on 3D photographs