Abstract:While recently published face alignment algorithms mainly focused on occlusion, low image quality, and complex head poses, subtle variances of facial components were often overlooked. In this correspondence paper, we propose a new approach called cascaded elastically progressive model aiming for pixel-wise landmark localization. First of all, elastically progressive model (EPM) is designed to synthesize the prior knowledge of face shape and appearance of test image. More specifically, a novel framework referred to as inherent linear structure (ILS) is explored for capturing the characteristics of the shape, which is more plastic and flexible than extensively used principle component analysis-based modeling. A locally linear support vector machine (LL-SVM) is used as local expert for searching candidate feature points. In order to optimally integrate ILS with localization results of LL-SVM, we introduce Kalman filter (KF) to dynamically estimate the true shape in the sense of least mean square error. Two schemes are utilized based on our modeling of KF. First, we embedded heuristic line-like search strategy into the framework to guarantee and accelerate the convergence. Second, Kalman gain is manipulated adaptively in accordance with the confidence of the localizers so that poorly localized points are more subject to global constraint than well localized ones. To further improve robustness to initializations, two EPMs are cascaded, in which primary EPM detects the global structure and secondary EPM captures the details. Validation experiments are conducted on in-the-wild LFPW and HELEN databases. Our method shows advantages for accurate landmark localization compared with prevailing methods.

Enhanced Pictorial Structures for Precise Eye Localization under Incontrolled Conditions

Accurate Iris Center Localization Method Using Facial Landmark, Snakuscule, Circle Fitting and Binary Connected Component

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Robust Three-step Facial Landmark Localization under the Complicated Condition via ASM and POEM.

Direct Alignment with Generalized Correspondences: A Unified Framework for Structure-Based Visual Pose Estimation.

Facial Feature Localization Using Robust Active Shape Model and POEM Descriptors

Face Sketch Landmarks Localization in the Wild

Robust 3D Face Recognition by Local Shape Difference Boosting

Robust Face Recognition by Constrained Part-based Alignment.

A Literature Survey on Robust and Efficient Eye Localization in Real-Life Scenarios

Robust Face Image Alignment Using Structural Priors

A structure-guided approach to the prediction of natural image saliency

Cascaded Elastically Progressive Model for Accurate Face Alignment

Visibility-aware Part Model for Robust Facial Point Detection

Pose-robust Face Recognition Via Part-Based Sparse Representation

Personal Fixations-Based Object Segmentation With Object Localization and Boundary Preservation

Robust and Precise Facial Landmark Detection by Self-Calibrated Pose Attention Network

Robust Precise Eye Location Under Probabilistic Framework

Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settings

Locality-Constrained Structral Orthogonal Procrustes Regression For Low-Resolution Face Recognition With Pose Variations

A Robust Coarse-to-Fine Method for Pupil Localization in Non-ideal Eye Images