Abstract:As an emerging research topic for proximity service (ProSe), automatic emotion recognition enables the machines to understand the emotional changes of human beings which can not only facilitate natural, effective, seamless, and advanced human–robot interaction or human–computer interface but also promote emotional health. Facial expression recognition (FER) is a vital task for emotion recognition. However, significant gap between human and machine exists in FER task. In this paper, we present a conditional generative adversarial network-based approach to alleviate the intra-class variations by individually controlling the facial expressions and learning the generative and discriminative representations simultaneously. The proposed framework consists of a generator G and three discriminators ( Di , Da , and Dexp ). The generator G transforms any query face image into another prototypic facial expression image with other factors preserved. Armed with action units condition, the generator G pays more attention to information relevant to facial expression. Three loss functions ( $L_{I}$ , La , and Lexp ) corresponding to the three discriminators ( Di , Da , and Dexp ) were designed to learn generative and discriminative representations. Moreover, after rendering the generated expression back to its original facial expression, cycle consistency loss is also applied to guarantee the identity and produce more constrained visual representations. Optimized by combining both synthesis and classification loss functions, the learnt representation is explicitly disentangled from other variations such as identity, head pose, and illumination. Qualitative and quantitative experimental results demonstrate the proposed FER system is effective for expression recognition.

Research on the embedded system of facial expression recognition based on HMM

WiFace: Facial Expression Recognition Using Wi-Fi Signals

Real-Time facial expression recognition system based on HMM and feature point localization

A Facial Expression Emotion Recognition Based Human-robot Interaction System

Cgan Based Facial Expression Recognition for Human-Robot Interaction

The Human Facial Combined Expression Recognition System

A Real-Time and Privacy-Preserving Facial Expression Recognition System Using an AI-Powered Microcontroller

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

Real-Time Facial Expression Recognition Based on the Improved Brain Emotional Learning Model

Intelligent Facial Emotion Recognition and Semantic-Based Topic Detection for A Humanoid Robot

A Multimodal Emotional Communication Based Humans-Robots Interaction System

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Portable Facial Expression System Based on EMG Sensors and Machine Learning Models

Research and Implementation of a Facial Emotion Recognition System Based on ZYNQ

Emotion Expression of Robot with Personality

Highly Robust and Wearable Facial Expression Recognition via Deep-Learning-Assisted, Soft Epidermal Electronics

A Fast and Accurate Multi-Model Facial Expression Recognition Method for Affective Intelligent Robots

Research on Dynamic Facial Expressions Recognition

Expression Recognition Based on Human Emotion-Attention Circuit

Emotional Communication Robot Based on 3D Face Model and ASR Technology

A real time face emotion classification and recognition using deep learning model