Abstract:Recently, there are increasing interests in inferring mirco-expression from facial image sequences. Due to subtle facial movement of micro-expressions, feature extraction has become an important and critical issue for spontaneous facial micro-expression recognition. Recent works usually used spatiotemporal local binary pattern for micro-expression analysis. However, the commonly used spatiotemporal local binary pattern considers dynamic texture information to represent face images while misses the shape attribute of face images. On the other hand, their works extracted the spatiotemporal features from the global face regions, which ignore the discriminative information between two micro-expression classes. The above-mentioned problems seriously limit the application of spatiotemporal local binary pattern on micro-expression recognition. In this paper, we propose a discriminative spatiotemporal local binary pattern based on an improved integral projection to resolve the problems of spatiotemporal local binary pattern for micro-expression recognition. Firstly, we develop an improved integral projection for preserving the shape attribute of micro-expressions. Furthermore, an improved integral projection is incorporated with local binary pattern operators across spatial and temporal domains. Specifically, we extract the novel spatiotemporal features incorporating shape attributes into spatiotemporal texture features. For increasing the discrimination of micro-expressions, we propose a new feature selection based on Laplacian method to extract the discriminative information for facial micro-expression recognition. Intensive experiments are conducted on three availably published micro-expression databases. We compare our method with the state-of-the-art algorithms. Experimental results demonstrate that our proposed method achieves promising performance for micro-expression recognition.

Micro-expression recognition based on local binary patterns from three orthogonal planes and nearest neighbor method

Micro-Expression Recognition Using Color Spaces.

Micro-expression Recognition Based on LBP-TOP Features

Micro-expression Recognition Using Dynamic Textures on Tensor Independent Color Space

Micro-Expression Recognition by Aggregating Local Spatio-Temporal Patterns.

Sparse Spatiotemporal Descriptor for Micro-Expression Recognition Using Enhanced Local Cube Binary Pattern

Spontaneous Facial Micro-Expression Recognition using Discriminative Spatiotemporal Local Binary Pattern with an Improved Integral Projection

Spontaneous Facial Micro-Expression Analysis Using Spatiotemporal Completed Local Quantized Patterns

Facial Micro-Expression Recognition Based on Deep Local-Holistic Network

Discriminative Spatiotemporal Local Binary Pattern with Revisited Integral Projection for Spontaneous Facial Micro-Expression Recognition

Facial Micro-Expressions: an Overview

Casme Ii: an Improved Spontaneous Micro-Expression Database and the Baseline Evaluation

Micro-expression recognition based on depth map to point cloud

Micro-Expression Recognition Based on Spatiotemporal Gabor Filters

Research of Micro-expression Recognition Model Based on Feature Unit

Micro-expression recognition based on multi-scale 3D residual convolutional neural network

A Survey of Micro-expression Recognition Methods Based on LBP, Optical Flow and Deep Learning

Macro-to-micro Transformation Model for Micro-Expression Recognition

Micro-Expression Recognition Based on Local Two-Order Gradient Pattern

Micro-Expression Recognition Based on Nodal Efficiency in the EEG Functional Networks

Microexpression Identification and Categorization Using a Facial Dynamics Map