Expression-Guided Attention GAN for Fine-Grained Facial Expression Editing

Hui Zhang,Shiqi Shen,Jinhua Xu
DOI: https://doi.org/10.1109/ICME55011.2023.00045
2023-01-01
Abstract:Facial expression editing aims at manipulating the expression of a face image with fine-grained conditions, while keeping the irrelevant regions unchanged. Previous methods have certain limitations in the quality of generated images and usually suffer from changing condition-irrelevant regions, such as background and facial details. In this paper, we propose an expression-guided attention GAN (EGA-GAN) to achieve fine-grained facial expression editing. We take the relative Facial Action Units (AUs) as the condition for target expression. The conditions are used to control two modules called latent space manipulation and multi-scale feature manipulation. The former is designed to edit expression and generate realistic and natural expression changes, and the latter is designed to preserve the unrelated region. To take advantages of both modules, we generate an attention mask from the expression condition and the input image to fuse the features of the two modules in a fine-grained manner. Through experiments, we show that our method achieves state-of-the-art performance on the accuracy of expression editing and can better disentangle the change of expression from irrelevant regions.
What problem does this paper attempt to address?