Abstract:Face alignment is a critical task in many multimedia and vision applications that use face-based algorithms. Recent research has focused on achieving efficient initialization to improve performance; however, the use of facial attributes and the extent of their correlation with initialization have not been fully exploited. This paper presents a lightweight method called expression- and pose-based adaptive initialization (EXPAI), in which facial attributes, that is, expression and pose information, are used as priors. This approach can significantly improve the face alignment performance. In addition, reliable expression and head pose information can be derived simultaneously in the same framework. First, an expression- and pose-based template dictionary is formed by augmenting the mean shape across three degrees of freedom, thereby substantially improving the robustness of the initial shape with respect to large head pose variations. Second, each the template corresponds to an image of interest, which is jointly determined using a shape-constrained multiclass classifier and binary classifiers, and is assigned a pretrained confidence coefficient. The initial shape that is thus generated for subsequent cascaded regression is more adaptive and enables higher accuracy. Furthermore, EXPAI enables initialization with significantly increased computational efficiency because of its independence from the original dataset. The experimental results obtained on the widely used 300-W dataset show that our method achieves very competitive performance compared with that of state-of-the-art methods. In particular, for the challenging subset of 300-W, EXPAI reduces errors by more than 14% compared with coarse-to-fine shape searching (CFSS), which currently exhibits the best performance among regression-based approaches. Furthermore, a speed increase of more than 10 times compared with CFSS is achieved.

A novel initialization method based on genetic algorithm for simultaneous pose and correspondence estimation

Simultaneous Pose and Correspondence Estimation Based on Genetic Algorithm

Pose Estimation and Neural Implicit Reconstruction Towards Non-Cooperative Spacecraft Without Offline Prior Information

Unseen Object Pose Estimation via Registration

Global Pose Estimation Iterative Algorithm for Multi-camera from Point and Line Correspondences

Direct Alignment with Generalized Correspondences: A Unified Framework for Structure-Based Visual Pose Estimation.

A Hybrid Genetic Algorithm For Relative Pose Estimation Captured By Hand-Held Camera

A Recursive Least Square Method for 3D Pose Graph Optimization Problem

Robust Initialization of Multi-camera SLAM with Limited View Overlaps and Inaccurate Extrinsic Calibration

Fast vision-based pose estimation iterative algorithm

A Novel Algorithm for Pose Estimation Based on Generalized Orthogonal Iteration with Uncertainty-Weighted Measuring Error of Feature Points

Feature Matching for Automated and Reliable Initialization in Three-Dimensional Digital Image Correlation

A Novel Initialization Method for Nonnegative Matrix Factorization and Its Application in Component Recognition with Three-Dimensional Fluorescence Spectra

Multi-initialization Optimization Network for Accurate 3D Human Pose and Shape Estimation

Robust Dual Quadric Initialization for Forward-Translating Camera Movements

Monocular SLAM Initialization Using Epipolar and Homography Model

Face Alignment with Expression- and Pose-Based Adaptive Initialization

An Efficient Iterative Pose Estimation Algorithm

Image registration with position and similarity constraints based on genetic algorithm

Pose estimation of 3D rigid object based on tentative point correspondence

A Robust and Efficient Visual-Inertial Initialization with Probabilistic Normal Epipolar Constraint