Abstract:Recent methods for 2D facial landmark localization perform well on close-to-frontal faces, but 2D landmarks are insufficient to represent 3D structure of a facial shape. For applications that require better accuracy, such as facial motion capture and 3D shape recovery, 3DA-2D (2D Projections of 3D Facial Annotations) is preferred. Inferring the 3D structure from a single image is an ill-posed problem whose accuracy and robustness are not always guaranteed. This paper aims to solve accurate 2D facial landmark localization and the transformation between 2D and 3DA-2D landmarks. One way to increase the accuracy is to input more precisely annotated facial images. The traditional cascaded regressions cannot effectively handle large or noisy training data sets. In this paper, we propose a Mini-Batch Cascaded Regressions (MBCR) method that can iteratively train a robust model from a large data set. Benefiting from the incremental learning strategy and a small learning rate, MBCR is robust to noise in training data. We also propose a new Cross-Dimension Annotations Conversion (CDAC) method to map facial landmarks from 2D to 3DA-2D coordinates and vice versa. The experimental results showed that CDAC combined with MBCR outperforms the-state-of-the-art methods in 3DA-2D facial landmark localization. Moreover, CDAC can run efficiently at up to 110 fps on a 3.4 GHz-CPU workstation. Thus, CDAC provides a solution to transform existing 2D alignment methods into 3DA-2D ones without slowing down the speed. Training and testing code as well as the data set can be downloaded from https://github.com/SWJTU-3DVision/CDAC.

Structure-Aware Long Short-Term Memory Network for 3D Cephalometric Landmark Detection

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

CephaNet: an Improved Faster R-CNN for Cephalometric Landmark Detection.

Automatic Detection of Craniomaxillofacial Anatomical Landmarks on CBCT Images Using 3D Mask R-CNN.

Localization of Craniomaxillofacial Landmarks on CBCT Images Using 3D Mask R-CNN and Local Dependency Learning

Fast and Accurate Craniomaxillofacial Landmark Detection Via 3D Faster R-CNN.

Anatomical Landmarks Annotation on 2D Lateral Cephalograms with Channel Attention

CephaNN: A Multi-Head Attention Network for Cephalometric Landmark Detection.

Learning-based local-to-global landmark annotation for automatic 3D cephalometry

Automatic Localization of Landmarks in Craniomaxillofacial CBCT Images Using a Local Attention-Based Graph Convolution Network.

Robust Multi-scale Anatomical Landmark Detection in Incomplete 3D-CT Data

Landmark Localization for Cephalometric Analysis Using Multiscale Image Patch-Based Graph Convolutional Networks

Automatic Cephalometric Landmark Identification System Based on the Multi-Stage Convolutional Neural Networks with CBCT Combination Images

An Attention-Guided Deep Regression Model for Landmark Detection in Cephalograms

Anchor Ball Regression Model for large-scale 3D skull landmark detection

CMF-Net: Craniomaxillofacial Landmark Localization on CBCT Images Using Geometric Constraint and Transformer

A Pseudo-3d Coarse-to-Fine Architecture for 3d Medical Landmark Detection

An Efficient Deep Learning Based Coarse-to-Fine Cephalometric Landmark Detection Method

A Novel Landmark Detection Method for Cephalometric Measurement

Fast and Robust Detection of Anatomical Landmarks Using Cascaded 3D Convolutional Networks Guided by Linear Square Regression.