Abstract:Recently, there are increasing interests in inferring mirco-expression from facial image sequences. Due to subtle facial movement of micro-expressions, feature extraction has become an important and critical issue for spontaneous facial micro-expression recognition. Recent works usually used spatiotemporal local binary pattern for micro-expression analysis. However, the commonly used spatiotemporal local binary pattern considers dynamic texture information to represent face images while misses the shape attribute of face images. On the other hand, their works extracted the spatiotemporal features from the global face regions, which ignore the discriminative information between two micro-expression classes. The above-mentioned problems seriously limit the application of spatiotemporal local binary pattern on micro-expression recognition. In this paper, we propose a discriminative spatiotemporal local binary pattern based on an improved integral projection to resolve the problems of spatiotemporal local binary pattern for micro-expression recognition. Firstly, we develop an improved integral projection for preserving the shape attribute of micro-expressions. Furthermore, an improved integral projection is incorporated with local binary pattern operators across spatial and temporal domains. Specifically, we extract the novel spatiotemporal features incorporating shape attributes into spatiotemporal texture features. For increasing the discrimination of micro-expressions, we propose a new feature selection based on Laplacian method to extract the discriminative information for facial micro-expression recognition. Intensive experiments are conducted on three availably published micro-expression databases. We compare our method with the state-of-the-art algorithms. Experimental results demonstrate that our proposed method achieves promising performance for micro-expression recognition.

Facial Expression Recognition Based on the Fusion of Spatio-temporal Features in Video Sequences

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Micro-expression Recognition Using Dynamic Textures on Tensor Independent Color Space

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Adaptive key-frame selection-based facial expression recognition via multi-cue dynamic features hybrid fusion

Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework

Spontaneous Facial Expression Recognition by Using Feature-Level Fusion of Visible and Thermal Infrared Images

Learning Expression Features via Deep Residual Attention Networks for Facial Expression Recognition From Video Sequences

Learning Dynamics for Video Facial Expression Recognition

Spontaneous Facial Micro-Expression Recognition using Discriminative Spatiotemporal Local Binary Pattern with an Improved Integral Projection

Facial Micro-Expression Recognition Based on Multi-Scale Temporal and Spatial Features

Affective Video Classification Based on Spatio-temporal Feature Fusion

Learning facial expression and body gesture visual information for video emotion recognition

Automatic Analysis of Facial Expressions Based on Deep Covariance Trajectories

Research on Dynamic Facial Expressions Recognition

Expression Recognition from 3D Dynamic Faces Using Robust Spatio-Temporal Shape Features

Dual-STI: Dual-path spatial-temporal interaction learning for dynamic facial expression recognition

Facial Expression Recognition Based on Deep Evolutional Spatial-Temporal Networks