Abstract:As an emerging research topic for proximity service (ProSe), automatic emotion recognition enables the machines to understand the emotional changes of human beings which can not only facilitate natural, effective, seamless, and advanced human–robot interaction or human–computer interface but also promote emotional health. Facial expression recognition (FER) is a vital task for emotion recognition. However, significant gap between human and machine exists in FER task. In this paper, we present a conditional generative adversarial network-based approach to alleviate the intra-class variations by individually controlling the facial expressions and learning the generative and discriminative representations simultaneously. The proposed framework consists of a generator G and three discriminators ( Di , Da , and Dexp ). The generator G transforms any query face image into another prototypic facial expression image with other factors preserved. Armed with action units condition, the generator G pays more attention to information relevant to facial expression. Three loss functions ( $L_{I}$ , La , and Lexp ) corresponding to the three discriminators ( Di , Da , and Dexp ) were designed to learn generative and discriminative representations. Moreover, after rendering the generated expression back to its original facial expression, cycle consistency loss is also applied to guarantee the identity and produce more constrained visual representations. Optimized by combining both synthesis and classification loss functions, the learnt representation is explicitly disentangled from other variations such as identity, head pose, and illumination. Qualitative and quantitative experimental results demonstrate the proposed FER system is effective for expression recognition.

3d Facial Expression Recognition Based On Kinect

Cgan Based Facial Expression Recognition for Human-Robot Interaction

3D Dynamic Facial Expression Recognition Using Low-Resolution Videos

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

A Facial Expression Emotion Recognition Based Human-robot Interaction System

Fully automatic 3D facial expression recognition using a region-based approach

FaceWarehouse: A 3D Facial Expression Database for Visual Computing

Automatic 2.5-D Facial Landmarking and Emotion Annotation for Social Interaction Assistance

Attention mechanism-based CNN for facial expression recognition

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

Real-time Facial Expression Recognition "In The Wild'' by Disentangling 3D Expression from Identity

Emotional Communication Robot Based on 3D Face Model and ASR Technology

Automatic 3D Facial Expression Recognition Based on a Bayesian Belief Net and a Statistical Facial Feature Model

Feature Level Analysis for 3D Facial Expression Recognition.

A Fast and Accurate Multi-Model Facial Expression Recognition Method for Affective Intelligent Robots

Facial Expression Recognition with LBP and ORB Features

Robust 3D face modeling and tracking from RGB-D images

Improving Human-Robot Interaction by Enhancing NAO Robot Awareness of Human Facial Expression

Online Facial Expression Imitation for Humanoid Robot Based on RBF Neural Network

Recognition of Emotions Using Kinects