Abstract:Cephalometry is commonly used as an integral component in orthodontic treatment and visual treatment objects (VTOs). Accurate and stable tissue landmarks’ localization is an essential precondition for orthodontic diagnosis and treatment. In practice, expert manual annotation is often time-consuming and subjective. Recent works based on deep learning have two approaches for automatic cephalometric assessment, namely, multimodel-and end-to-end model-based methods, leading to substantial differences in landmarks’ localization accuracy. The multimodel-based methods predict each landmark with higher localization accuracy, but they are complex, and their parameters have to be adjusted iteratively. The end-to-end models are both lightweight and efficient, and are able to predict all landmarks at once, but their localization accuracy is significantly lower than that of the multimodel-based methods. This article aims at rethinking the different natures among models and presents an effective solution for the low accuracy end-to-end model. On the one hand, we design a two-stage network architecture to improve the model representation ability. We found that the input image with high resolution and multistage strategy can effectively improve the localization accuracy of the model. Therefore, the former stage employs an HR-Net to output multiple-scale feature maps in parallel from high-resolution radiography images. The latter stage further refines the landmark location from the generated features. On the other hand, thanks to its spatial representation of landmark location, the network-based heatmap prediction has become a mainstream method for regressing the landmarks’ coordinates thanks. However, the decoding method of heatmap has not been studied in cephalometry. Thus, we propose an improved heatmaps’ decoding method that effectively reduces the landmarks’ localization error during training. Furthermore, experimental results show that our approach outperforms previous related works on a public dataset and yields state-of-the-art (SoTA) accuracy in cephalometric landmarks’ detection.

HIH: Towards More Accurate Face Alignment via Heatmap in Heatmap

A Heatmap Regression Approach for Right Ventricle Anatomical Landmarks Localization on Echocardiography

Robust Face Alignment by Multi-Order High-Precision Hourglass Network

Towards Highly Accurate and Stable Face Alignment for High-Resolution Videos.

Heterogeneous heatmap distillation framework based on unbiased alignment for lightweight human pose estimation

Heatmap Regression Via Randomized Rounding.

Attentive One-Dimensional Heatmap Regression for Facial Landmark Detection and Tracking

Small and accurate heatmap-based face alignment via distillation strategy and cascaded architecture

Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction

Boosting Integral-Based Human Pose Estimation Through Implicit Heatmap Learning

Heatmap Distribution Matching for Human Pose Estimation

Robust Facial Landmark Detection Via Heatmap-Offset Regression

Efficient and Stable Cephalometric Landmark Localization Using Two-Stage Heatmaps’ Regression

ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

Quality-aware Face Alignment Using High-Resolution Spatial Dependencies

Large-Pose Face Alignment Via Shape-Aware Heatmap

Heatmap-Guided Selective Feature Attention for Robust Cascaded Face Alignment

Keep an Eye on Faces: Robust Face Detection with Heatmap-Assisted Spatial Attention and Scale-Aware Layer Attention.

Error Compensation Heatmap Decoding for Human Pose Estimation.

Sub-pixel face landmarks using heatmaps and a bag of tricks

Joint Stacked Hourglass Network and Salient Region Attention Refinement for Robust Face Alignment