Abstract:While Convolutional Neural Networks (CNNs) have significantly boosted the performance of face related algorithms, maintaining accuracy and efficiency simultaneously in practical use remains challenging. The state-of-the-art methods employ deeper networks for better performance, which makes it less practical for mobile applications because of more parameters and higher computational complexity. Therefore, we propose an efficient multitask neural network, Alignment & Tracking & Pose Network (ATPN) for face alignment, face tracking and head pose estimation. Specifically, to achieve better performance with fewer layers for face alignment, we introduce a shortcut connection between shallow-layer and deep-layer features. We find the shallow-layer features are highly correspond to facial boundaries that can provide the structural information of face and it is crucial for face alignment. Moreover, we generate a cheap heatmap based on the face alignment result and fuse it with features to improve the performance of the other two tasks. Based on the heatmap, the network can utilize both geometric information of landmarks and appearance information for head pose estimation. The heatmap also provides attention clues for face tracking. The face tracking task also saves us the face detection procedure for each frame, which also significantly boost the real-time capability for video-based tasks. We experimentally validate ATPN on four benchmark datasets, WFLW, 300VW, WIDER Face and 300W-LP. The experimental results demonstrate that it achieves better performance with much less parameters and lower computational complexity compared to other light models.

Joint Face Detection and Alignment Using Focal Loss-Based Multi-task Convolutional Neural Networks

MTCNN and FACENET Based Access Control System for Face Detection and Recognition

Rotation-Invariant Face Detection with Multi-task Progressive Calibration Networks.

End-to-End Spatial Transform Face Detection and Recognition

Combining Convolutional and Recurrent Neural Networks for Classification of Focal Liver Lesions in Multi-phase CT Images.

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

Multi-task Convolution Network for Face Alignment

Acceleration of multi-task cascaded convolutional networks

Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks

Multi-face detection and alignment using multiple kernels

Joint Learning for Face Alignment and Face Transfer with Depth Image

Multitask learning and CNN for application of face recognition.

Joint Multi-View Face Alignment in the Wild

Multi-Label Dilated Recurrent Network for Sequential Face Alignment

Multistage Model for Robust Face Alignment Using Deep Neural Networks

Face Detection With End-To-End Integration Of A Convnet And A 3d Model

An Efficient Multitask Neural Network for Face Alignment, Head Pose Estimation and Face Tracking

CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution

Efficient Face Alignment with Fast Normalization and Contour Fitting Loss

NPCFace: Negative-Positive Collaborative Training for Large-scale Face Recognition

Co-attentive multi-task convolutional neural network for facial expression recognition