Abstract:Cephalometry is commonly used as an integral component in orthodontic treatment and visual treatment objects (VTOs). Accurate and stable tissue landmarks’ localization is an essential precondition for orthodontic diagnosis and treatment. In practice, expert manual annotation is often time-consuming and subjective. Recent works based on deep learning have two approaches for automatic cephalometric assessment, namely, multimodel-and end-to-end model-based methods, leading to substantial differences in landmarks’ localization accuracy. The multimodel-based methods predict each landmark with higher localization accuracy, but they are complex, and their parameters have to be adjusted iteratively. The end-to-end models are both lightweight and efficient, and are able to predict all landmarks at once, but their localization accuracy is significantly lower than that of the multimodel-based methods. This article aims at rethinking the different natures among models and presents an effective solution for the low accuracy end-to-end model. On the one hand, we design a two-stage network architecture to improve the model representation ability. We found that the input image with high resolution and multistage strategy can effectively improve the localization accuracy of the model. Therefore, the former stage employs an HR-Net to output multiple-scale feature maps in parallel from high-resolution radiography images. The latter stage further refines the landmark location from the generated features. On the other hand, thanks to its spatial representation of landmark location, the network-based heatmap prediction has become a mainstream method for regressing the landmarks’ coordinates thanks. However, the decoding method of heatmap has not been studied in cephalometry. Thus, we propose an improved heatmaps’ decoding method that effectively reduces the landmarks’ localization error during training. Furthermore, experimental results show that our approach outperforms previous related works on a public dataset and yields state-of-the-art (SoTA) accuracy in cephalometric landmarks’ detection.

Super-resolution landmark detection networks for medical images

Craniomaxillofacial Bone Segmentation and Landmark Detection Using Semantic Segmentation Networks and an Unbiased Heatmap.

CephaNet: an Improved Faster R-CNN for Cephalometric Landmark Detection.

FDGR-Net: Feature Decouple and Gated Recalibration Network for Medical Image Landmark Detection

Medical image super-resolution with laplacian dense network

Automatic Localization of Landmarks in Craniomaxillofacial CBCT Images Using a Local Attention-Based Graph Convolution Network.

Learn Fine-Grained Adaptive Loss for Multiple Anatomical Landmark Detection in Medical Images

CephaNN: A Multi-Head Attention Network for Cephalometric Landmark Detection.

DLLNet: An Attention-Based Deep Learning Method for Dental Landmark Localization on High-Resolution 3D Digital Dental Models

Neighborhood evaluator for efficient super-resolution reconstruction of 2D medical images

Multi-level landmark-guided deep network for face super-resolution

Automatic Detection of Craniomaxillofacial Anatomical Landmarks on CBCT Images Using 3D Mask R-CNN.

A Novel 3D Medical Image Super-Resolution Method Based on Densely Connected Network

Spine Landmark Localization with combining of Heatmap Regression and Direct Coordinate Regression

An Automatic Cephalometric Landmark Detection Method Based on Heatmap Regression and Monte Carlo Dropout

You Only Learn Once: Universal Anatomical Landmark Detection

Fast and Accurate Craniomaxillofacial Landmark Detection Via 3D Faster R-CNN.

An Automated Method of 3D Facial Soft Tissue Landmark Prediction Based on Object Detection and Deep Learning

Medical Image Super Resolution Reconstruction Based on Residual Network

Robust Facial Landmark Detection by Multi-order Multi-constraint Deep Networks

Efficient and Stable Cephalometric Landmark Localization Using Two-Stage Heatmaps’ Regression