Abstract:In this paper, we propose a structure-coherent deep feature learning method for face alignment. Unlike most existing face alignment methods which overlook the facial structure cues, we explicitly exploit the relation among facial landmarks to make the detector robust to hard cases such as occlusion and large pose. Specifically, we leverage a landmark-graph relational network to enforce the structural relationships among landmarks. We consider the facial landmarks as structural graph nodes and carefully design the neighborhood to passing features among the most related nodes. Our method dynamically adapts the weights of node neighborhood to eliminate distracted information from noisy nodes, such as occluded landmark point. Moreover, different from most previous works which only tend to penalize the landmarks absolute position during the training, we propose a relative location loss to enhance the information of relative location of landmarks. This relative location supervision further regularizes the facial structure. Our approach considers the interactions among facial landmarks and can be easily implemented on top of any convolutional backbone to boost the performance. Extensive experiments on three popular benchmarks, including WFLW, COFW and 300W, demonstrate the effectiveness of the proposed method. In particular, due to explicit structure modeling, our approach is especially robust to challenging cases resulting in impressive low failure rate on COFW and WFLW datasets. The model and code are publicly available at https://github.com/BeierZhu/Sturcture-Coherency-Face-Alignment.

3D Dense Face Alignment via Graph Convolution Networks

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

3D Dense Face Alignment with Fused Features by Aggregating CNNs and GCNs

Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

Faster, Better and More Detailed: 3D Face Reconstruction with Graph Convolutional Networks

Linkage Based Face Clustering Via Graph Convolution Network

Multi-task Convolution Network for Face Alignment

Face Alignment Across Large Poses: A 3D Solution

Towards Fast, Accurate and Stable 3D Dense Face Alignment

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

Graph Structure Reasoning Network for Face Alignment and Reconstruction

Dynamic Spatio-Temporal Feature Learning via Graph Convolution in 3D Convolutional Networks

3D Face Reprentation and Reconstruction with Multi-scale Graph Convolutional Autoencoders

CRNet:3D Face Reconstruction with Contour Map Regression Network

Approach to 3D face reconstruction through local deep feature alignment

Structure-Coherent Deep Feature Learning for Robust Face Alignment

Cascaded Deep Convolutional Neural Network for Robust Face Alignment.

Real-time Memory Efficient Large-pose Face Alignment via Deep Evolutionary Network

Face-GCN: A Graph Convolutional Network for 3D Dynamic Face Identification/Recognition

Advanced 3D Face Reconstruction from Single 2D Images Using Enhanced Adversarial Neural Networks and Graph Neural Networks