Abstract:The mainstream direction in face alignment is now dominated by cascaded regression methods. These methods start from an image with an initial shape and build a set of shape increments based on features with respect to the current estimated shape. These shape increments move the initial shape to the desired location. Despite the advantages of the cascaded methods, they all share two major limitations: (i) shape increments are learned independently from each other in a cascaded manner, (ii) the use of standard generic computer vision features such SIFT, HOG, does not allow these methods to learn problem-specific features. In this work, we propose a novel Recurrent Convolutional Shape Regression (RCSR) method that overcomes these limitations. We formulate the standard cascaded alignment problem as a recurrent process and learn all shape increments jointly, by using a recurrent neural network with a gated recurrent unit. Importantly, by combining a convolutional neural network with a recurrent one we avoid hand-crafted features, widely adopted in the literature and thus we allow the model to learn task-specific features. Besides, we employ the convolutional gated recurrent unit which takes as input the feature tensors instead of flattened feature vectors. Therefore, the spatial structure of the features can be better preserved in the memory of the recurrent neural network. Moreover, both the convolutional and the recurrent neural networks are learned jointly. Experimental evaluation shows that the proposed method has better performance than the state-of-the-art methods, and further supports the importance of learning a single end-to-end model for face alignment.

M3 CSR: Multi-view, multi-scale and multi-component cascade shape regression

M3 csr

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

Multi‐scale Cross‐domain Alignment for Person Image Generation

Cascade of Forests for Face Alignment

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

Dual Sparse Constrained Cascade Regression for Robust Face Alignment.

Adaptive Cascade Regression Model for Robust Face Alignment.

Face Alignment via Multi-Regressors Collaborative Optimization.

Shape Augmented Regression For 3d Face Alignment

Feedback Cascade Regression Model for Face Alignment

Robust Face Recognition by Constrained Part-based Alignment.

Extended Robust Cascaded Pose Regression for Face Alignment

Robust 3D Face Recognition by Local Shape Difference Boosting

Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment

Recurrent Convolutional Shape Regression

Pose-Indexed Based Multi-View Method For Face Alignment

Face Alignment with Two-Layer Shape Regression

Coupled cascade regression from real and synthesized faces for simultaneous landmark detection and head pose estimation

3D Facial Expression Reconstruction using Cascaded Regression