Abstract:Recently, there are increasing interests in inferring mirco-expression from facial image sequences. Due to subtle facial movement of micro-expressions, feature extraction has become an important and critical issue for spontaneous facial micro-expression recognition. Recent works usually used spatiotemporal local binary pattern for micro-expression analysis. However, the commonly used spatiotemporal local binary pattern considers dynamic texture information to represent face images while misses the shape attribute of face images. On the other hand, their works extracted the spatiotemporal features from the global face regions, which ignore the discriminative information between two micro-expression classes. The above-mentioned problems seriously limit the application of spatiotemporal local binary pattern on micro-expression recognition. In this paper, we propose a discriminative spatiotemporal local binary pattern based on an improved integral projection to resolve the problems of spatiotemporal local binary pattern for micro-expression recognition. Firstly, we develop an improved integral projection for preserving the shape attribute of micro-expressions. Furthermore, an improved integral projection is incorporated with local binary pattern operators across spatial and temporal domains. Specifically, we extract the novel spatiotemporal features incorporating shape attributes into spatiotemporal texture features. For increasing the discrimination of micro-expressions, we propose a new feature selection based on Laplacian method to extract the discriminative information for facial micro-expression recognition. Intensive experiments are conducted on three availably published micro-expression databases. We compare our method with the state-of-the-art algorithms. Experimental results demonstrate that our proposed method achieves promising performance for micro-expression recognition.

Spontaneous Versus Posed Smile Recognition Using Discriminative Local Spatial-Temporal Descriptors

Spontaneous Versus Posed Smile Recognition Via Region-Specific Texture Descriptor and Geometric Facial Dynamics

Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework

Posed and Spontaneous Expression Recognition Through Modeling Their Spatial Patterns

Spontaneous vs. Posed smiles - can we tell the difference?

How Do You Smile? Towards a Comprehensive Smile Analysis System

Posed and Spontaneous Expression Recognition Through Restricted Boltzmann Machine.

Distinguishing Posed and Spontaneous Smiles by Facial Dynamics

Sparse Spatiotemporal Descriptor for Micro-Expression Recognition Using Enhanced Local Cube Binary Pattern

Spontaneous Facial Micro-Expression Recognition using Discriminative Spatiotemporal Local Binary Pattern with an Improved Integral Projection

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Recognising Spontaneous Facial Micro-Expressions

Micro-Expression Recognition by Aggregating Local Spatio-Temporal Patterns.

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Capturing Spatial and Temporal Patterns for Distinguishing Between Posed and Spontaneous Expressions

Convolutional Neural Networks for Posed and Spontaneous Expression Recognition

Real-Time facial expression recognition system based on HMM and feature point localization

Fully automatic 3D facial expression recognition using a region-based approach

An Efficient Method For Facial Expression Recognition

Spontaneous Facial Expression Recognition Based on Feature Point Tracking

A new descriptor of gradients Self-Similarity for smile detection in unconstrained scenarios.