Abstract:As an emerging research topic for proximity service (ProSe), automatic emotion recognition enables the machines to understand the emotional changes of human beings which can not only facilitate natural, effective, seamless, and advanced human–robot interaction or human–computer interface but also promote emotional health. Facial expression recognition (FER) is a vital task for emotion recognition. However, significant gap between human and machine exists in FER task. In this paper, we present a conditional generative adversarial network-based approach to alleviate the intra-class variations by individually controlling the facial expressions and learning the generative and discriminative representations simultaneously. The proposed framework consists of a generator G and three discriminators ( Di , Da , and Dexp ). The generator G transforms any query face image into another prototypic facial expression image with other factors preserved. Armed with action units condition, the generator G pays more attention to information relevant to facial expression. Three loss functions ( $L_{I}$ , La , and Lexp ) corresponding to the three discriminators ( Di , Da , and Dexp ) were designed to learn generative and discriminative representations. Moreover, after rendering the generated expression back to its original facial expression, cycle consistency loss is also applied to guarantee the identity and produce more constrained visual representations. Optimized by combining both synthesis and classification loss functions, the learnt representation is explicitly disentangled from other variations such as identity, head pose, and illumination. Qualitative and quantitative experimental results demonstrate the proposed FER system is effective for expression recognition.

Photorealistic Facial Expression Synthesis by the Conditional Difference Adversarial Autoencoder

Expression Conditional Gan for Facial Expression-to-Expression Translation.

Realistic Face Reenactment Via Self-Supervised Disentangling of Identity and Pose

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Facial Landmarks and Expression Label Guided Photorealistic Facial Expression Synthesis

Facial Expression Transfer Based on Conditional Generative Adversarial Networks.

Action Unit Driven Facial Expression Synthesis from a Single Image with Patch Attentive GAN.

Identity- and Pose-Robust Facial Expression Recognition Through Adversarial Feature Learning

Region Based Adversarial Synthesis of Facial Action Units

Adaptively Learning Facial Expression Representation via C-F Labels and Distillation

A data-driven approach for facial expression synthesis in video

Deep Neural Network Augmentation: Generating Faces for Affect Analysis

Facial Aging and Rejuvenation by Conditional Multi-Adversarial Autoencoder with Ordinal Regression

2D/3D Expression Generation Using Advanced Learning Techniques and the Emotion Wheel

Synthetic Expressions are Better Than Real for Learning to Detect Facial Actions

Emotic Masked Autoencoder with Attention Fusion for Facial Expression Recognition

Facial expression recognition and generation using sparse autoencoder

Joint Expression Synthesis and Representation Learning for Facial Expression Recognition

DualPathGAN: Facial reenacted emotion synthesis

Facial expressional image synthesis controlled by emotional parameters