Abstract:Recently, there are increasing interests in inferring mirco-expression from facial image sequences. Due to subtle facial movement of micro-expressions, feature extraction has become an important and critical issue for spontaneous facial micro-expression recognition. Recent works usually used spatiotemporal local binary pattern for micro-expression analysis. However, the commonly used spatiotemporal local binary pattern considers dynamic texture information to represent face images while misses the shape attribute of face images. On the other hand, their works extracted the spatiotemporal features from the global face regions, which ignore the discriminative information between two micro-expression classes. The above-mentioned problems seriously limit the application of spatiotemporal local binary pattern on micro-expression recognition. In this paper, we propose a discriminative spatiotemporal local binary pattern based on an improved integral projection to resolve the problems of spatiotemporal local binary pattern for micro-expression recognition. Firstly, we develop an improved integral projection for preserving the shape attribute of micro-expressions. Furthermore, an improved integral projection is incorporated with local binary pattern operators across spatial and temporal domains. Specifically, we extract the novel spatiotemporal features incorporating shape attributes into spatiotemporal texture features. For increasing the discrimination of micro-expressions, we propose a new feature selection based on Laplacian method to extract the discriminative information for facial micro-expression recognition. Intensive experiments are conducted on three availably published micro-expression databases. We compare our method with the state-of-the-art algorithms. Experimental results demonstrate that our proposed method achieves promising performance for micro-expression recognition.

Posed and Spontaneous Expression Recognition Through Modeling Their Spatial Patterns

Posed and Spontaneous Expression Recognition Through Restricted Boltzmann Machine.

Analyses of the Differences between Posed and Spontaneous Facial Expressions

Spontaneous Versus Posed Smile Recognition Using Discriminative Local Spatial-Temporal Descriptors

Facial Expression Recognition Through Modeling Age-Related Spatial Patterns.

Posed and Spontaneous Expression Distinction Using Latent Regression Bayesian Networks

Convolutional Neural Networks for Posed and Spontaneous Expression Recognition

Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework

Spontaneous Versus Posed Smile Recognition Via Region-Specific Texture Descriptor and Geometric Facial Dynamics

Spontaneous facial expression recognition: A robust metric learning approach

Capturing Spatial and Temporal Patterns for Distinguishing Between Posed and Spontaneous Expressions

In-the-wild Facial Expression Recognition in Extreme Poses

Capturing Global Spatial Patterns for Distinguishing Posed and Spontaneous Expressions

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Capturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition

Learning Prototypes and Similes on Grassmann Manifold for Spontaneous Expression Recognition

Automatic facial expression recognition based on spatiotemporal descriptors

Spontaneous Expression Recognition Based on Visual Attention Mechanism and Co-salient Features.

Posed and spontaneous facial expression differentiation using deep Boltzmann machines

Subtle expression recognition-a comprehensive approach

Spontaneous Facial Micro-Expression Recognition using Discriminative Spatiotemporal Local Binary Pattern with an Improved Integral Projection