Abstract:As an emerging research topic for proximity service (ProSe), automatic emotion recognition enables the machines to understand the emotional changes of human beings which can not only facilitate natural, effective, seamless, and advanced human–robot interaction or human–computer interface but also promote emotional health. Facial expression recognition (FER) is a vital task for emotion recognition. However, significant gap between human and machine exists in FER task. In this paper, we present a conditional generative adversarial network-based approach to alleviate the intra-class variations by individually controlling the facial expressions and learning the generative and discriminative representations simultaneously. The proposed framework consists of a generator G and three discriminators ( Di , Da , and Dexp ). The generator G transforms any query face image into another prototypic facial expression image with other factors preserved. Armed with action units condition, the generator G pays more attention to information relevant to facial expression. Three loss functions ( $L_{I}$ , La , and Lexp ) corresponding to the three discriminators ( Di , Da , and Dexp ) were designed to learn generative and discriminative representations. Moreover, after rendering the generated expression back to its original facial expression, cycle consistency loss is also applied to guarantee the identity and produce more constrained visual representations. Optimized by combining both synthesis and classification loss functions, the learnt representation is explicitly disentangled from other variations such as identity, head pose, and illumination. Qualitative and quantitative experimental results demonstrate the proposed FER system is effective for expression recognition.

A Facial Expression Model For Human-Like Agent

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Synthesis of Combined Facial Expressions Using Anatomy-based Model

Facial Expression Animation Based on Physical Model

Research on Facial Action Model for Human-like Agent

Modeling Expressions of Peking Opera Facial Make-Ups

Design and Realization of a Multi-DoF Robotic Head for Affective Humanoid Facial Expression Imitation.

Video Tracked Facial Expression Animation

Implementation of Emotional Facial Actions for Human-Like Agents in a Multi-Tasking Environment

Research and Implement of Facial Action on Human-like Agent

Human-robot facial coexpression

Quick Customization of Particular Human Face and Muscle-Driven Expression Animation

Video-driven state-aware facial animation

Facial expressional image synthesis controlled by emotional parameters

Facial Expression Cloning with Elastic and Muscle Models.

Real-Time facial expression recognition system based on HMM and feature point localization

Facial Expression Synthesis and Recognition Using a Kernel-Based Factorization Model

Capturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition

Individual facial image synthesis system for a virtual human

Facial Expression Synthesis Based on Facial Expression Decomposition and Warping

Facial Expression Retargeting from Human to Avatar Made Easy