Abstract:As an emerging research topic for proximity service (ProSe), automatic emotion recognition enables the machines to understand the emotional changes of human beings which can not only facilitate natural, effective, seamless, and advanced human–robot interaction or human–computer interface but also promote emotional health. Facial expression recognition (FER) is a vital task for emotion recognition. However, significant gap between human and machine exists in FER task. In this paper, we present a conditional generative adversarial network-based approach to alleviate the intra-class variations by individually controlling the facial expressions and learning the generative and discriminative representations simultaneously. The proposed framework consists of a generator G and three discriminators ( Di , Da , and Dexp ). The generator G transforms any query face image into another prototypic facial expression image with other factors preserved. Armed with action units condition, the generator G pays more attention to information relevant to facial expression. Three loss functions ( $L_{I}$ , La , and Lexp ) corresponding to the three discriminators ( Di , Da , and Dexp ) were designed to learn generative and discriminative representations. Moreover, after rendering the generated expression back to its original facial expression, cycle consistency loss is also applied to guarantee the identity and produce more constrained visual representations. Optimized by combining both synthesis and classification loss functions, the learnt representation is explicitly disentangled from other variations such as identity, head pose, and illumination. Qualitative and quantitative experimental results demonstrate the proposed FER system is effective for expression recognition.

Generation of Artificial FO-contours of Emotional Speech with Generative Adversarial Networks

A Model of Emotional Speech Generation Based on Conditional Generative Adversarial Networks

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Emotional Speech Generator by using Generative Adversarial Networks

Temporal conditional Wasserstein GANs for audio-visual affect-related ties

Learning Representations of Emotional Speech with Deep Convolutional Generative Adversarial Networks

EmoSpeaker: One-shot Fine-grained Emotion-Controlled Talking Face Generation

Improving Speech Emotion Recognition With Adversarial Data Augmentation Network

Generative Listener EEG for Speech Emotion Recognition Using Generative Adversarial Networks with Compressed Sensing

High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learning

Can Deep Generative Audio be Emotional? Towards an Approach for Personalised Emotional Audio Generation

EmoEden: Applying Generative Artificial Intelligence to Emotional Learning for Children with High-Function Autism

Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networks

Non-parallel Emotion Conversion using a Deep-Generative Hybrid Network and an Adversarial Pair Discriminator

Data Augmentation Using Conditional GANs for Facial Emotion Recognition

Generative Adversarial Networks in Human Emotion Synthesis:A Review

F0 Transformation for Emotional Speech Synthesis Using Target Approximation Features and Bidirectional Associative Memories

Emotionally Controllable Talking Face Generation from an Arbitrary Emotional Portrait

Converting Anyone's Emotion: Towards Speaker-Independent Emotional Voice Conversion

SEC-GAN for robust speaker recognition with emotional state dismatch