Face Rotation and Recognition Based on Attention Mechanism and Generative Adversarial Networks

Hong Li,Nanfeng Xiao
DOI: https://doi.org/10.1109/iccss53909.2021.9721953
2021-01-01
Abstract:Face rotation can enrich imbalanced data and improve face recognition performance. However most of the previous methods focus on identity information. Therefore, this paper firstly proposes a novel attended pose-guided generative adversarial network (APGAN) to synthesize an arbitrary target posed photorealistic human face from the original one, while maintaining the identity and the expression information. The proposed model is mainly composed of heatmap-based generator with attention and dual discriminators with attention. Adaptive attention mechanism is proposed to concentrate on critical facial organs and maintain local structure during face rotation, for achieving more precise information preservation. Integrated expression learning exploits the shared low-level features and the inherited correlation between the two tasks, furtherly improves the expression recognition capability. Attribute purification, dynamic loss weights and alternative dataset training strengthen the performance and alienate the overfitting problem together. APGAN model is trained on small-scale dataset KDEF, challenging the robustness of the networks. The extensive experimental results on the qualitative analysis and the quantitative comparison, demonstrate that the proposed model outperformances the previous face rotation methods and expression recognition methods.
What problem does this paper attempt to address?