Abstract:Cephalometry is commonly used as an integral component in orthodontic treatment and visual treatment objects (VTOs). Accurate and stable tissue landmarks’ localization is an essential precondition for orthodontic diagnosis and treatment. In practice, expert manual annotation is often time-consuming and subjective. Recent works based on deep learning have two approaches for automatic cephalometric assessment, namely, multimodel-and end-to-end model-based methods, leading to substantial differences in landmarks’ localization accuracy. The multimodel-based methods predict each landmark with higher localization accuracy, but they are complex, and their parameters have to be adjusted iteratively. The end-to-end models are both lightweight and efficient, and are able to predict all landmarks at once, but their localization accuracy is significantly lower than that of the multimodel-based methods. This article aims at rethinking the different natures among models and presents an effective solution for the low accuracy end-to-end model. On the one hand, we design a two-stage network architecture to improve the model representation ability. We found that the input image with high resolution and multistage strategy can effectively improve the localization accuracy of the model. Therefore, the former stage employs an HR-Net to output multiple-scale feature maps in parallel from high-resolution radiography images. The latter stage further refines the landmark location from the generated features. On the other hand, thanks to its spatial representation of landmark location, the network-based heatmap prediction has become a mainstream method for regressing the landmarks’ coordinates thanks. However, the decoding method of heatmap has not been studied in cephalometry. Thus, we propose an improved heatmaps’ decoding method that effectively reduces the landmarks’ localization error during training. Furthermore, experimental results show that our approach outperforms previous related works on a public dataset and yields state-of-the-art (SoTA) accuracy in cephalometric landmarks’ detection.

Sub-pixel face landmarks using heatmaps and a bag of tricks

Face Sketch Landmarks Localization in the Wild

A Heatmap Regression Approach for Right Ventricle Anatomical Landmarks Localization on Echocardiography

Robust Facial Landmark Detection Via Heatmap-Offset Regression

Attentive One-Dimensional Heatmap Regression for Facial Landmark Detection and Tracking

Efficient and Stable Cephalometric Landmark Localization Using Two-Stage Heatmaps’ Regression

A Robust Facial Landmark Detector with Mixed Loss

Robust and efficient facial landmark localization

A Detailed Look At CNN-based Approaches In Facial Landmark Detection

Infinite 3D Landmarks: Improving Continuous 2D Facial Landmark Detection

3D face reconstruction with dense landmarks

Score-Guided Face Alignment Network Under Occlusions.

Precise Facial Landmark Detection by Reference Heatmap Transformer

Facial Landmark Localization by Gibbs Sampling

106-Point Facial Landmark Localization with Mobile Networks Based on Regression.

Facial Landmark Localization by Enhanced Convolutional Neural Network.

Stack of Heatmap Hourglass Network for Face Alignment

Attention-Based Accurate and Robust Facial Landmark Detector

SFRA: spatial fusion regression augmentation network for facial landmark detection

Accurate Landmarking from 3D Facial Scans by CNN and Cascade Regression.