Abstract:In recent years, convolutional neural networks (CNNs) have played a dominant role in facial expression recognition. While CNN-based methods have achieved remarkable success, they are notorious for having an excessive number of parameters, and they rely on a large amount of manually annotated data. To address this challenge, we expand the number of training samples by learning expressions from a face recognition dataset to reduce the impact of a small number of samples on the network training. In the proposed deep joint learning framework, the deep features of the face recognition dataset are clustered, and simultaneously, the parameters of an efficient CNN are learned, thereby marking the data for network training automatically and efficiently. Specifically, first, we develop a new efficient CNN based on the proposed affinity convolution module with much lower computational overhead for deep feature learning and expression classification. Then, we develop an expression-guided deep facial clustering approach to cluster the deep features and generate abundant expression labels from the face recognition dataset. Finally, the AC-based CNN is fine-tuned using an updated training set and a combined loss function. Our framework is evaluated on several challenging facial expression recognition datasets as well as a self-collected dataset. In the context of facial expression recognition applied to the field of education, our proposed method achieved an impressive accuracy of 95.87% on the self-collected dataset, surpassing other existing methods.

Joint sparse learning for 3-D facial expression generation.

Sparse coding for flexible, robust 3D facial-expression synthesis.

3D Facial Expression Synthesis Based on Nonlinear Co-learning

Coupled Dictionary Learning for the Detail-Enhanced Synthesis of 3-D Facial Expressions

Personalized 3-D facial expression synthesis based on landmark constraint.

A Unified Deep Model for Joint Facial Expression Recognition, Face Synthesis, and Face Alignment.

LBF Based 3D Regression for Facial Animation

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

Video Tracked Facial Expression Animation

Video-driven state-aware facial animation

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Learn2Talk: 3D Talking Face Learns from 2D Talking Face

Facial Landmarks and Expression Label Guided Photorealistic Facial Expression Synthesis

Jointly Optimizing Expressional and Residual Models for 3D Facial Expression Removal.

Joint Head Pose and Facial Landmark Regression from Depth Images

Expressive 3D face synthesis by multi-space modeling

Expression-Guided Deep Joint Learning for Facial Expression Recognition

Facial Representation Extraction by Mutual Information Maximization and Correlation Minimization.

Joint Sketch-Attribute Learning for Fine-Grained Face Synthesis.

A Piece-Wise Learning Approach To 3d Facial Animation

Emotional Conversation: Empowering Talking Faces with Cohesive Expression, Gaze and Pose Generation