Abstract:Automatic facial expression recognition is an emerging field. Moreover, the interest has been increased with the transition from laboratory-controlled conditions to in the wild scenarios. Most of the research has been done over nonoccluded faces under the constrained environment, while automatic facial expression is less understood/implemented for partial occlusion in the real world conditions. Apart from that, our research aims to tackle the issues of overfitting (caused by the shortage of adequate training data) and to alleviate the expression-unrelated/intraclass/nonlinear facial variations, such as head pose estimation, eye gaze estimation, intensity and microexpressions. In our research, we control the magnitude of each Action Unit (AU) and combine several of the Action Unit combinations to leverage learning from the generative and discriminative representations for automatic FER. We have also addressed the problem of diversification of expressions from lab controlled to real-world scenarios from our cross-database study and proposed a model for enhancement of the discriminative power of deep features while increasing the interclass scatters, by preserving the locality closeness. Furthermore, facial expression consists of an expressive component as well as neutral component, so we proposed a generative model which is capable of generating neutral expression from an input image using cGAN. The expressive component is filtered and passed to the intermediate layers and the process is called De-expression Residue Learning. The residue in the intermediate/middle layers is very important for learning through expressive components. Finally, we validate the effectiveness of our method (DLP-DeRL) through qualitative and quantitative experimental results using four databases. Our method is more accurate and robust, and outperforms all the existing methods (hand crafted features and deep learning) while dealing the images in the wild.

Facial Expression Animation by Landmark Guided Residual Module

Facial Landmarks and Expression Label Guided Photorealistic Facial Expression Synthesis

Expression-Latent-Space-guided GAN for Facial Expression Animation Based on Discrete Labels

Facial Prior Guided Micro-Expression Generation.

Facial Expression Animation Through Action Units Transfer in Latent Space.

Video-driven state-aware facial animation

Video Tracked Facial Expression Animation

Facial Expression Translation Using Landmark Guided GANs

Expressive 3D Facial Animation Generation Based on Local-to-Global Latent Diffusion

Learning Expression Features via Deep Residual Attention Networks for Facial Expression Recognition From Video Sequences

Subtle expression recognition-a comprehensive approach

Enhancing Facial Consistency in Conditional Video Generation via Facial Landmark Transformation

Subtle Facial Expression Synthesis Using Motion Manifold Embedding and Nonlinear Decomposable Generative Models

LGA-GAN: landmarks guided attentive generative adversarial network for facial expression manipulation

Emotional Conversation: Empowering Talking Faces with Cohesive Expression, Gaze and Pose Generation

Expressive Speech-driven Facial Animation with controllable emotions

Facial Expression Recognition of Nonlinear Facial Variations Using Deep Locality De-Expression Residue Learning in the Wild

A video prediction approach for animating single face image

Semantic prior guided fine-grained facial expression manipulation

Displaced Dynamic Expression Regression for Real-Time Facial Tracking and Animation