Abstract:While Convolutional Neural Networks (CNNs) have significantly boosted the performance of face related algorithms, maintaining accuracy and efficiency simultaneously in practical use remains challenging. The state-of-the-art methods employ deeper networks for better performance, which makes it less practical for mobile applications because of more parameters and higher computational complexity. Therefore, we propose an efficient multitask neural network, Alignment & Tracking & Pose Network (ATPN) for face alignment, face tracking and head pose estimation. Specifically, to achieve better performance with fewer layers for face alignment, we introduce a shortcut connection between shallow-layer and deep-layer features. We find the shallow-layer features are highly correspond to facial boundaries that can provide the structural information of face and it is crucial for face alignment. Moreover, we generate a cheap heatmap based on the face alignment result and fuse it with features to improve the performance of the other two tasks. Based on the heatmap, the network can utilize both geometric information of landmarks and appearance information for head pose estimation. The heatmap also provides attention clues for face tracking. The face tracking task also saves us the face detection procedure for each frame, which also significantly boost the real-time capability for video-based tasks. We experimentally validate ATPN on four benchmark datasets, WFLW, 300VW, WIDER Face and 300W-LP. The experimental results demonstrate that it achieves better performance with much less parameters and lower computational complexity compared to other light models.

Lightweight Boundary-Aware Face Alignment with Compressed HourglassNet and Transformer

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

SD-HRNet: Slimming and Distilling High-Resolution Network for Efficient Face Alignment

An Improved Boundary-Aware Face Alignment Using Stacked Dense U-Nets

Learning Deformable Hourglass Networks (Dhgn) For Unconstrained Face Alignment

AdaptiveNet - Toward an Efficient Face Alignment Algorithm.

Deformable Hourglass Network with Face Region Normalization for Robust Face Alignment

FreeEnricher: Enriching Face Landmarks Without Additional Cost

Stacked Dense U-Nets with Dual Transformers for Robust Face Alignment

Multistage Model for Robust Face Alignment Using Deep Neural Networks

Quality-aware Face Alignment Using High-Resolution Spatial Dependencies

Joint Stacked Hourglass Network and Salient Region Attention Refinement for Robust Face Alignment

Attention-Guided Coarse-to-Fine Network for 2D Face Alignment in the Wild

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.

Efficient Face Alignment with Fast Normalization and Contour Fitting Loss

Small and accurate heatmap-based face alignment via distillation strategy and cascaded architecture

The High Precision Real-Time Facial Landmark Detection Technique Based on ShufflenetV2.

Robust Face Alignment Via Adaptive Attention-Based Graph Convolutional Network

An Efficient Multitask Neural Network for Face Alignment, Head Pose Estimation and Face Tracking

Towards efficient masked-face alignment via cascaded regression

Face Alignment by Deep Convolutional Network with Adaptive Learning Rate.