Abstract:Recent methods for 2D facial landmark localization perform well on close-to-frontal faces, but 2D landmarks are insufficient to represent 3D structure of a facial shape. For applications that require better accuracy, such as facial motion capture and 3D shape recovery, 3DA-2D (2D Projections of 3D Facial Annotations) is preferred. Inferring the 3D structure from a single image is an ill-posed problem whose accuracy and robustness are not always guaranteed. This paper aims to solve accurate 2D facial landmark localization and the transformation between 2D and 3DA-2D landmarks. One way to increase the accuracy is to input more precisely annotated facial images. The traditional cascaded regressions cannot effectively handle large or noisy training data sets. In this paper, we propose a Mini-Batch Cascaded Regressions (MBCR) method that can iteratively train a robust model from a large data set. Benefiting from the incremental learning strategy and a small learning rate, MBCR is robust to noise in training data. We also propose a new Cross-Dimension Annotations Conversion (CDAC) method to map facial landmarks from 2D to 3DA-2D coordinates and vice versa. The experimental results showed that CDAC combined with MBCR outperforms the-state-of-the-art methods in 3DA-2D facial landmark localization. Moreover, CDAC can run efficiently at up to 110 fps on a 3.4 GHz-CPU workstation. Thus, CDAC provides a solution to transform existing 2D alignment methods into 3DA-2D ones without slowing down the speed. Training and testing code as well as the data set can be downloaded from https://github.com/SWJTU-3DVision/CDAC.

Global Structure Constraint: A Fast Pre-location for Active Appearance Model

Active shape model based on sparse representation

GLocal: Global Graph Reasoning and Local Structure Transfer for Person Image Generation

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

Facial Features Extraction Based on Active Shape Model.

Combining Active Shape Models and Active Appearance Models For Accurate Image Interpretation

Texture-Constrained Active Shape Models

Enhance the Alignment Accuracy of Active Shape Models Using Elastic Graph Matching

An Enhanced Active Shape Model for Facial Features Extraction

SEMI-GLOBAL STEREO MATCHING COMBINED WITH STRUCTURE CONSTRAINT

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Global Structure-from-Motion Revisited

Constraint Shape Model Using Edge Constraint and Gabor Wavelet Based Search

Enhanced Pictorial Structures for Precise Eye Localization under Incontrolled Conditions

Enhance ASMs Based on AdaBoost-Based Salient Landmarks Localization and Confidence-Constraint Shape Modeling

Generic Face Alignment Using an Improved Active Shape Model

Multi-view face alignment guided by several facial feature points

GMMLoc: Structure Consistent Visual Localization with Gaussian Mixture Models

Fast Structural Global Registration of Indoor Colored Point Cloud

Locating facial landmarks by support vector machine-based active shape model

Optimal Feature Point Selection and Automatic Initialization in Active Shape Model Search