Abstract:As an emerging research topic for proximity service (ProSe), automatic emotion recognition enables the machines to understand the emotional changes of human beings which can not only facilitate natural, effective, seamless, and advanced human–robot interaction or human–computer interface but also promote emotional health. Facial expression recognition (FER) is a vital task for emotion recognition. However, significant gap between human and machine exists in FER task. In this paper, we present a conditional generative adversarial network-based approach to alleviate the intra-class variations by individually controlling the facial expressions and learning the generative and discriminative representations simultaneously. The proposed framework consists of a generator G and three discriminators ( Di , Da , and Dexp ). The generator G transforms any query face image into another prototypic facial expression image with other factors preserved. Armed with action units condition, the generator G pays more attention to information relevant to facial expression. Three loss functions ( $L_{I}$ , La , and Lexp ) corresponding to the three discriminators ( Di , Da , and Dexp ) were designed to learn generative and discriminative representations. Moreover, after rendering the generated expression back to its original facial expression, cycle consistency loss is also applied to guarantee the identity and produce more constrained visual representations. Optimized by combining both synthesis and classification loss functions, the learnt representation is explicitly disentangled from other variations such as identity, head pose, and illumination. Qualitative and quantitative experimental results demonstrate the proposed FER system is effective for expression recognition.

Ghost-based Convolutional Neural Network for Effective Facial Expression Recognition

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Facial Expression Recognition Using Deep Neural Network

The Facial Expression Recognition Method Based on Image Fusion and CNN

Effective Facial Expression Recognition via the Boosted Convolutional Neural Network

Fast and Efficient Facial Expression Recognition Using a Gabor Convolutional Network

Facial Expression Recognition Based on Convolutional Neural Network with Sparse Representation

Facial Attention based Convolutional Neural Network for 2D+3D Facial Expression Recognition

Facial Expression Recognition Via Region-Based Convolutional Fusion Network.

Video-based Facial Expression Recognition Using Graph Convolutional Networks.

Multi-level Spatial and Semantic Enhancement Network for Expression Recognition

Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy

Static Facial Expression Recognition with Convolution Neural Networks

Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields

Facial expression recognition through multi-level features extraction and fusion

E-FCNN for Tiny Facial Expression Recognition.

FER-Net: Facial Expression Recognition Using Densely Connected Convolutional Network

Facial expression recognition using HOG and LBP features with convolutional neural network

Facial Expression Recognition Based On Global And Local Feature Fusion With Cnns

GCF: Graph Convolutional Networks for Facial Expression Recognition

FERNet: A Deep CNN Architecture for Facial Expression Recognition in the Wild