Abstract:Face alignment is a typical facial behavior analysis task in computer vision. However, the performance of face alignment is degraded greatly when the face image is partially occluded. In order to achieve better mapping between facial appearance features and shape increments, we propose a robust and occlusion-free face alignment algorithm in which a face de-occlusion module and a deep regression module are integrated into a cascaded deep generative regression model. The face de-occlusion module is a disentangled representation learning Generative Adversarial Networks (GANs) which aims to locate occlusions and recover the genuine appearance from partially occluded face image. The deep regression module can enhance facial appearance representation by utilizing the recovered faces to obtain more accurate regressors. Then, by the cascaded deep generative regression model, we recover the partially occluded face image and achieve accurate locating of landmarks gradually. It is interesting to show that the cascaded deep generative regression model can effectively locate occlusions and recover more genuine faces, which can be further used to improve the performance of face alignment. Experimental results conducted on four challenging occluded face datasets demonstrate that our method outperforms state-of-the-art methods.

Cascaded Deep Convolutional Neural Network for Robust Face Alignment.

Adaptive Cascade Deep Convolutional Neural Networks for face alignment

Cascade of Forests for Face Alignment

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Face Alignment Algorithm Based on an Improved Cascaded Convolutional Neural Network

End-to-End Spatial Transform Face Detection and Recognition

Improved Face Detection and Alignment using Cascade Deep Convolutional Network

Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks

Face Alignment by Deep Convolutional Network with Adaptive Learning Rate.

Robust Face Alignment With Cascaded Coarse-To-Fine Auto-Encoder Network

Learning Cascaded Deep Auto-Encoder Networks for Face Alignment

Deep Shape Constrained Network for Robust Face Alignment.

Face Alignment with Cascaded Bidirectional LSTM Neural Networks.

Robust Face Alignment by Cascaded Regression and De-Occlusion

Region-Based Face Alignment With Convolution Neural Network Cascade

Multistage Model for Robust Face Alignment Using Deep Neural Networks

Pose Aided Deep Convolutional Neural Networks for Face Alignment.

Towards efficient masked-face alignment via cascaded regression

Robust Face Alignment Based on Hierarchical Classifier Network

Effective face landmark localization via single deep network

Learning a Multi-Center Convolutional Network for Unconstrained Face Alignment.