Abstract:Spontaneous facial expression recognition is significantly more challenging than recognizing posed ones. We focus on two issues that are still under-addressed in this area. First, due to the inherent subtlety, the geometric and appearance features of spontaneous expressions tend to overlap with each other, making it hard for classifiers to find effective separation boundaries. Second, the training set usually contains dubious class labels which can hurt the recognition performance if no countermeasure is taken. In this paper, we propose a spontaneous expression recognition method based on robust metric learning with the aim of alleviating these two problems. In particular, to increase the discrimination of different facial expressions, we learn a new metric space in which spatially close data points have a higher probability of being in the same class. In addition, instead of using the noisy labels directly for metric learning, we define sensitivity and specificity to characterize the annotation reliability of each annotator. Then the distance metric and annotators' reliability is jointly estimated by maximizing the likelihood of the observed class labels. With the introduction of latent variables representing the true class labels, the distance metric and annotators' reliability can be iteratively solved under the Expectation Maximization framework. Comparative experiments show that our method achieves better recognition accuracy on spontaneous expression recognition, and the learned metric can be reliably transferred to recognize posed expressions.

Posed and Spontaneous Expression Recognition Through Restricted Boltzmann Machine.

Capturing Spatial and Temporal Patterns for Distinguishing Between Posed and Spontaneous Expressions

Posed and Spontaneous Expression Recognition Through Modeling Their Spatial Patterns

Capturing Global Spatial Patterns for Distinguishing Posed and Spontaneous Expressions

Posed and spontaneous facial expression differentiation using deep Boltzmann machines

Facial Feature Tracking under Varying Facial Expressions and Face Poses based on Restricted Boltzmann Machines

Spontaneous Versus Posed Smile Recognition Using Discriminative Local Spatial-Temporal Descriptors

Posed and Spontaneous Expression Distinction Using Latent Regression Bayesian Networks

Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework

Convolutional Neural Networks for Posed and Spontaneous Expression Recognition

Real-Time Keypoint Recognition Using Restricted Boltzmann Machine

A Novel Dynamic Model Capturing Spatial and Temporal Patterns for Facial Expression Analysis

Spontaneous Versus Posed Smile Recognition Via Region-Specific Texture Descriptor and Geometric Facial Dynamics

Real-Time facial expression recognition system based on HMM and feature point localization

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Differentiating Between Posed And Spontaneous Expressions With Latent Regression Bayesian Network

Spontaneous facial expression recognition: A robust metric learning approach

Spontaneous Facial Expression Recognition Based on Feature Point Tracking

In-the-wild Facial Expression Recognition in Extreme Poses

Multiple Facial Action Unit Recognition Enhanced by Facial Expressions.

Subtle expression recognition-a comprehensive approach