Abstract:As an emerging research topic for proximity service (ProSe), automatic emotion recognition enables the machines to understand the emotional changes of human beings which can not only facilitate natural, effective, seamless, and advanced human–robot interaction or human–computer interface but also promote emotional health. Facial expression recognition (FER) is a vital task for emotion recognition. However, significant gap between human and machine exists in FER task. In this paper, we present a conditional generative adversarial network-based approach to alleviate the intra-class variations by individually controlling the facial expressions and learning the generative and discriminative representations simultaneously. The proposed framework consists of a generator G and three discriminators ( Di , Da , and Dexp ). The generator G transforms any query face image into another prototypic facial expression image with other factors preserved. Armed with action units condition, the generator G pays more attention to information relevant to facial expression. Three loss functions ( $L_{I}$ , La , and Lexp ) corresponding to the three discriminators ( Di , Da , and Dexp ) were designed to learn generative and discriminative representations. Moreover, after rendering the generated expression back to its original facial expression, cycle consistency loss is also applied to guarantee the identity and produce more constrained visual representations. Optimized by combining both synthesis and classification loss functions, the learnt representation is explicitly disentangled from other variations such as identity, head pose, and illumination. Qualitative and quantitative experimental results demonstrate the proposed FER system is effective for expression recognition.

Facial expression classification using salient pattern driven integrated geometric and textual features

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Facial geometric feature extraction based emotional expression classification using machine learning algorithms

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Automatic Facial Expression Recognition Using Features of Salient Facial Patches

Recognition of facial expressions based on salient geometric features and support vector machines

Real-Time facial expression recognition system based on HMM and feature point localization

Facial Expression Recognition Using Hybrid Features of Pixel and Geometry

A deep-learning-based facial expression recognition method using textural features

Subtle expression recognition-a comprehensive approach

Facial Expression Recognition using Facial Landmark Detection and Feature Extraction via Neural Networks

Facial expression recognition with trade-offs between data augmentation and deep learning features

The Human Facial Combined Expression Recognition System

Facial Expression Recognition with LBP and ORB Features

Studies Advanced in Development and Application of Facial Expression Recognition

Region Based Robust Facial Expression Analysis

Facial Expression Recognition System Based on Multiple Feature Integration

Fully automatic 3D facial expression recognition using a region-based approach

Facial expression recognition using Eigen face approach

Facial expression recognition: a novel approach to captcha design

Objective Classes for Micro-Facial Expression Recognition