Abstract:Recently, there are increasing interests in inferring mirco-expression from facial image sequences. Due to subtle facial movement of micro-expressions, feature extraction has become an important and critical issue for spontaneous facial micro-expression recognition. Recent works usually used spatiotemporal local binary pattern for micro-expression analysis. However, the commonly used spatiotemporal local binary pattern considers dynamic texture information to represent face images while misses the shape attribute of face images. On the other hand, their works extracted the spatiotemporal features from the global face regions, which ignore the discriminative information between two micro-expression classes. The above-mentioned problems seriously limit the application of spatiotemporal local binary pattern on micro-expression recognition. In this paper, we propose a discriminative spatiotemporal local binary pattern based on an improved integral projection to resolve the problems of spatiotemporal local binary pattern for micro-expression recognition. Firstly, we develop an improved integral projection for preserving the shape attribute of micro-expressions. Furthermore, an improved integral projection is incorporated with local binary pattern operators across spatial and temporal domains. Specifically, we extract the novel spatiotemporal features incorporating shape attributes into spatiotemporal texture features. For increasing the discrimination of micro-expressions, we propose a new feature selection based on Laplacian method to extract the discriminative information for facial micro-expression recognition. Intensive experiments are conducted on three availably published micro-expression databases. We compare our method with the state-of-the-art algorithms. Experimental results demonstrate that our proposed method achieves promising performance for micro-expression recognition.

Capturing Global Spatial Patterns for Distinguishing Posed and Spontaneous Expressions

Posed and Spontaneous Expression Recognition Through Restricted Boltzmann Machine.

Capturing Spatial and Temporal Patterns for Distinguishing Between Posed and Spontaneous Expressions

Posed and Spontaneous Expression Recognition Through Modeling Their Spatial Patterns

Posed and Spontaneous Expression Distinction Using Latent Regression Bayesian Networks

Analyses of the Differences between Posed and Spontaneous Facial Expressions

Differentiating Between Posed And Spontaneous Expressions With Latent Regression Bayesian Network

A Novel Dynamic Model Capturing Spatial and Temporal Patterns for Facial Expression Analysis

Spontaneous Versus Posed Smile Recognition Using Discriminative Local Spatial-Temporal Descriptors

Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework

Discriminative Spatiotemporal Local Binary Pattern with Revisited Integral Projection for Spontaneous Facial Micro-Expression Recognition

Facial Expression Recognition Through Modeling Age-Related Spatial Patterns.

Learning Prototypes and Similes on Grassmann Manifold for Spontaneous Expression Recognition

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Facial Feature Tracking under Varying Facial Expressions and Face Poses based on Restricted Boltzmann Machines

Spontaneous Versus Posed Smile Recognition Via Region-Specific Texture Descriptor and Geometric Facial Dynamics

Spontaneous Facial Micro-Expression Recognition using Discriminative Spatiotemporal Local Binary Pattern with an Improved Integral Projection

Multiple Facial Action Unit Recognition Enhanced by Facial Expressions.

Sparse Spatiotemporal Descriptor for Micro-Expression Recognition Using Enhanced Local Cube Binary Pattern

A Sparse Representation Approach for Local Feature Based Expression Recognition

Capturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition