Abstract:Recent methods for 2D facial landmark localization perform well on close-to-frontal faces, but 2D landmarks are insufficient to represent 3D structure of a facial shape. For applications that require better accuracy, such as facial motion capture and 3D shape recovery, 3DA-2D (2D Projections of 3D Facial Annotations) is preferred. Inferring the 3D structure from a single image is an ill-posed problem whose accuracy and robustness are not always guaranteed. This paper aims to solve accurate 2D facial landmark localization and the transformation between 2D and 3DA-2D landmarks. One way to increase the accuracy is to input more precisely annotated facial images. The traditional cascaded regressions cannot effectively handle large or noisy training data sets. In this paper, we propose a Mini-Batch Cascaded Regressions (MBCR) method that can iteratively train a robust model from a large data set. Benefiting from the incremental learning strategy and a small learning rate, MBCR is robust to noise in training data. We also propose a new Cross-Dimension Annotations Conversion (CDAC) method to map facial landmarks from 2D to 3DA-2D coordinates and vice versa. The experimental results showed that CDAC combined with MBCR outperforms the-state-of-the-art methods in 3DA-2D facial landmark localization. Moreover, CDAC can run efficiently at up to 110 fps on a 3.4 GHz-CPU workstation. Thus, CDAC provides a solution to transform existing 2D alignment methods into 3DA-2D ones without slowing down the speed. Training and testing code as well as the data set can be downloaded from https://github.com/SWJTU-3DVision/CDAC.

Automatic Pose Correction for 3D Face Based on Nose Detection

3D Corrective Nose Reconstruction from a Single Image

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

The Correction Of The Distortion Of Human Face Based On Three-Dimensional Modeling Methods

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Towards More Accurate 3D Face Registration under the Guidance of Prior Anatomical Knowledge on Human Faces

Robust Facial Landmark Detection for Three-Dimensional Face Segmentation and Alignment

Automatic 3D Face Modeling Using 2D Active Appearance Models

Accurate 3D Face Registration Based on the Symmetry Plane Analysis on Nose Regions.

Real-time Localization of 3D Facial Landmarks

Robust 3D Face Recognition by Local Shape Difference Boosting

3D face registration by depth-based template matching and active appearance model

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

3D Nose: a Novel Biometrics

3D facial landmark localization via a local surface descriptor HoSNI

Automatic landmark annotation and dense correspondence registration for 3D human facial images

Pose-Invariant 3D Face Alignment

Nose Detection on 3D Face Images by Depth-Based Template Matching

Approach of Human Face Recognition Based on SIFT Feature Extraction and 3D Rotation Model