Abstract:Facial expression generation has always been an intriguing task for scientists and researchers all over the globe. In this context, we present our novel approach for generating videos of the six basic facial expressions. Starting from a single neutral facial image and a label indicating the desired facial expression, we aim to synthesize a video of the given identity performing the specified facial expression. Our approach, referred to as FEV-GAN (Facial Expression Video GAN), is based on Spatio-temporal Convolutional GANs, that are known to model both content and motion in the same network. Previous methods based on such a network have shown a good ability to generate coherent videos with smooth temporal evolution. However, they still suffer from low image quality and low identity preservation capability. In this work, we address this problem by using a generator composed of two image encoders. The first one is pre-trained for facial identity feature extraction and the second for spatial feature extraction. We have qualitatively and quantitatively evaluated our model on two international facial expression benchmark databases: MUG and Oulu-CASIA NIR&VIS. The experimental results analysis demonstrates the effectiveness of our approach in generating videos of the six basic facial expressions while preserving the input identity. The analysis also proves that the use of both identity and spatial features enhances the decoder ability to better preserve the identity and generate high-quality videos. The code and the pre-trained model will soon be made publicly available.

Video-based facial expression hallucination: a two- level hierarchical fusion approach

Facial Expression Hallucination Through Eigen-Associative Learning.

Self-Enhanced Convolutional Network for Facial Video Hallucination

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Video-driven state-aware facial animation

Multi-pose Face Hallucination Via Neighbor Embedding for Facial Components

Video Tracked Facial Expression Animation

A data-driven approach for facial expression synthesis in video

Video-Based Facial Animation with Detailed Appearance Texture

VidFace: A Full-Transformer Solver for Video FaceHallucination with Unaligned Tiny Snapshots

Video-based Facial Animation Techniques

3D Facial Expression Synthesis Based on Nonlinear Co-learning

Hierarchical facial expression animation by motion capture data

Facial Expression Synthesis Using Manifold Learning and Belief Propagation

Hierarchical fusion of visual and physiological signals for emotion recognition

Facial Expression Synthesis Based on Facial Expression Decomposition and Warping

A hierarchical algorithm with multi-feature fusion for facial expression recognition

Expressive 3D Facial Animation Generation Based on Local-to-Global Latent Diffusion

Facial Expression Video Generation Based-On Spatio-temporal Convolutional GAN: FEV-GAN

Adaptive key-frame selection-based facial expression recognition via multi-cue dynamic features hybrid fusion