Abstract:While Convolutional Neural Networks (CNNs) have significantly boosted the performance of face related algorithms, maintaining accuracy and efficiency simultaneously in practical use remains challenging. The state-of-the-art methods employ deeper networks for better performance, which makes it less practical for mobile applications because of more parameters and higher computational complexity. Therefore, we propose an efficient multitask neural network, Alignment & Tracking & Pose Network (ATPN) for face alignment, face tracking and head pose estimation. Specifically, to achieve better performance with fewer layers for face alignment, we introduce a shortcut connection between shallow-layer and deep-layer features. We find the shallow-layer features are highly correspond to facial boundaries that can provide the structural information of face and it is crucial for face alignment. Moreover, we generate a cheap heatmap based on the face alignment result and fuse it with features to improve the performance of the other two tasks. Based on the heatmap, the network can utilize both geometric information of landmarks and appearance information for head pose estimation. The heatmap also provides attention clues for face tracking. The face tracking task also saves us the face detection procedure for each frame, which also significantly boost the real-time capability for video-based tasks. We experimentally validate ATPN on four benchmark datasets, WFLW, 300VW, WIDER Face and 300W-LP. The experimental results demonstrate that it achieves better performance with much less parameters and lower computational complexity compared to other light models.

Quality-aware Face Alignment Using High-Resolution Spatial Dependencies

End-to-End Spatial Transform Face Detection and Recognition

Small and accurate heatmap-based face alignment via distillation strategy and cascaded architecture

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.

Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction

ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

Toward High Quality Facial Representation Learning

Face Alignment by Deep Convolutional Network with Adaptive Learning Rate.

Dynamic Deformable Transformer for End‐to‐end Face Alignment

Multistage Model for Robust Face Alignment Using Deep Neural Networks

SD-HRNet: Slimming and Distilling High-Resolution Network for Efficient Face Alignment

Lightweight Boundary-Aware Face Alignment with Compressed HourglassNet and Transformer

Robust Face Alignment via Deep Progressive Reinitialization and Adaptive Error-driven Learning

An Efficient Multitask Neural Network for Face Alignment, Head Pose Estimation and Face Tracking

Attention-Guided Coarse-to-Fine Network for 2D Face Alignment in the Wild

Evaluating the Quality of Face Alignment Without Ground Truth

PropagationNet: Propagate Points to Curve to Learn Structure Information

Face Alignment Across Large Poses: A 3D Solution

Efficient Face Alignment with Fast Normalization and Contour Fitting Loss

Towards End-to-End Face Recognition Method Through Spatial Transformer

Attentional Alignment Networks.