Abstract:As an emerging research topic for proximity service (ProSe), automatic emotion recognition enables the machines to understand the emotional changes of human beings which can not only facilitate natural, effective, seamless, and advanced human–robot interaction or human–computer interface but also promote emotional health. Facial expression recognition (FER) is a vital task for emotion recognition. However, significant gap between human and machine exists in FER task. In this paper, we present a conditional generative adversarial network-based approach to alleviate the intra-class variations by individually controlling the facial expressions and learning the generative and discriminative representations simultaneously. The proposed framework consists of a generator G and three discriminators ( Di , Da , and Dexp ). The generator G transforms any query face image into another prototypic facial expression image with other factors preserved. Armed with action units condition, the generator G pays more attention to information relevant to facial expression. Three loss functions ( $L_{I}$ , La , and Lexp ) corresponding to the three discriminators ( Di , Da , and Dexp ) were designed to learn generative and discriminative representations. Moreover, after rendering the generated expression back to its original facial expression, cycle consistency loss is also applied to guarantee the identity and produce more constrained visual representations. Optimized by combining both synthesis and classification loss functions, the learnt representation is explicitly disentangled from other variations such as identity, head pose, and illumination. Qualitative and quantitative experimental results demonstrate the proposed FER system is effective for expression recognition.

Perceptual Facial Expression Representation

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

Cgan Based Facial Expression Recognition for Human-Robot Interaction

How Do You Perceive My Face? Recognizing Facial Expressions in Multi-Modal Context by Modeling Mental Representations

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

The Devil is in the Face: Exploiting Harmonious Representations for Facial Expression Recognition

Automatic Recognition of Facial Displays of Unfelt Emotions

Towards Reading Beyond Faces for Sparsity-aware 3D/4D Affect Recognition

Real-time Facial Expression Recognition "In The Wild'' by Disentangling 3D Expression from Identity

Facial Expression Recognition by Expression-Specific Representation Swapping

Semantic-Rich Facial Emotional Expression Recognition

Learning Emotional-Blinded Face Representations

Self-Supervised Emotion Representation Disentanglement for Speech-Preserving Facial Expression Manipulation

Toward Identity-Invariant Facial Expression Recognition: Disentangled Representation via Mutual Information Perspective

Automated facial expression recognition using exemplar hybrid deep feature generation technique

Enhanced Dual-Level Representations for Facial Expression Recognition

Semantic Content in Face Representation: Essential for Proficient Recognition of Unfamiliar Faces by Good Recognizers

EMOCA: Emotion Driven Monocular Face Capture and Animation

Investigating Bias and Fairness in Facial Expression Recognition

Multi-Objective Based Spatio-Temporal Feature Representation Learning Robust to Expression Intensity Variations for Facial Expression Recognition