Abstract:As an emerging research topic for proximity service (ProSe), automatic emotion recognition enables the machines to understand the emotional changes of human beings which can not only facilitate natural, effective, seamless, and advanced human–robot interaction or human–computer interface but also promote emotional health. Facial expression recognition (FER) is a vital task for emotion recognition. However, significant gap between human and machine exists in FER task. In this paper, we present a conditional generative adversarial network-based approach to alleviate the intra-class variations by individually controlling the facial expressions and learning the generative and discriminative representations simultaneously. The proposed framework consists of a generator G and three discriminators ( Di , Da , and Dexp ). The generator G transforms any query face image into another prototypic facial expression image with other factors preserved. Armed with action units condition, the generator G pays more attention to information relevant to facial expression. Three loss functions ( $L_{I}$ , La , and Lexp ) corresponding to the three discriminators ( Di , Da , and Dexp ) were designed to learn generative and discriminative representations. Moreover, after rendering the generated expression back to its original facial expression, cycle consistency loss is also applied to guarantee the identity and produce more constrained visual representations. Optimized by combining both synthesis and classification loss functions, the learnt representation is explicitly disentangled from other variations such as identity, head pose, and illumination. Qualitative and quantitative experimental results demonstrate the proposed FER system is effective for expression recognition.

Human Facial Expression Mining Based on Cloud Model

Extraction and Representation of Common Feature from Uncertain Facial Expressions with Cloud Model

Emotion Recognition Using Cloud Model

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Faceknow: Facial Expression Recognition by a Global-Local Network with a Sub-Images-Related Contextual Attention Mechanism

Facial Expression Recognition Based on Auxiliary Models

The Human Facial Combined Expression Recognition System

MINING TIME SERIES DATA BASED UPON CLOUD MODEL

Personalized Emotion Recognition and Emotion Prediction System Based on Cloud Computing

Facial Expression Recognition Method Based on Multi-scale Detail Enhancement

Fine-Grained Facial Expression Analysis Using Dimensional Emotion Model

Improving the Facial Expression Recognition and Its Interpretability Via Generating Expression Pattern-map

Facial Expression Recognition and Synthesis on Affective Emotions Composition

Facial expression-based analysis on emotion correlations, hotspots, and potential occurrence of urban crimes

Expression Recognition Based on Convolutional Difference Contextual Feature Fusion

Human Emotion Recognition Based on Face and Facial Expression Detection Using Deep Belief Network Under Complicated Backgrounds

Expression Analysis Based on Face Regions in Real-world Conditions.

Expression Analysis Based on Face Regions in Read-world Conditions

Research of Micro-expression Recognition Model Based on Feature Unit

Region Based Robust Facial Expression Analysis

Facial Expression Recognition Based on DT-CWT and Weighted Inverse Cloud Model