Abstract:Facial expression which carries rich information of body behavior is the leading carrier of human affective and the symbol of intelligence. The main purpose of this paper is to recognize 3D human facial expression. The research in this paper includes the expression feature extraction algorithm and fusion with different kinds of feature. To contain more local texture feature information, we proposed a new feature of 3D facial expression named Local Threshold Binary Pattern (LTBP) which based on Local Binary Pattern (LBP). We calculate the difference of gray value standard between neighboring pixels and the center pixel as a threshold to binary instead of the traditional LBP operation which only comparison of size between neighboring pixels and the center pixel. After we get the LTBP feature, we fuse the LTBP and HOG (Histogram of Oriented Gradient) features to get multi-feature fusion for 3D facial expression recognition. Our algorithm of 3D facial expression recognition comprises three steps: (1) extracting two sets of feature vectors and establishing the correlation criterion function between the two sets of feature vectors; (2) solving the two sets canonical projective vectors and extracting their canonical correlation features by the framework of canonical correlation analysis algorithm; (3) doing feature fusion for classification by using proposed strategy. We have performed comprehensive experiments on the BU-3DFE database which is presently the largest available 3D face database. We have achieved verification rates of more than 90% for the 3D facial expression recognition.

3D Facial Expression Recognition Using Distance Features and LBP Features Based on Automatically Detected Keypoints

Fully Automatic 3D Facial Expression Recognition Using Local Depth Features

Automatic 3D facial expression recognition based on polytypic Local Binary Pattern

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

3D Facial Expression Recognition Based on Properties of Line Segments Connecting Facial Feature Points

3D face recognition using local binary patterns

3D Facial Expression Recognition Algorithm Using Local Threshold Binary Pattern and Histogram of Oriented Gradient

Fully Automatic 3D Facial Expression Recognition Using Polytypic Multi-Block Local Binary Patterns

A novel approach to enhance automatic 3D facial expression recognition

Expression-robust 3D face recognition using LBP representation

3D Facial expression recognition based on basic geometric features

3D Facial Expression Recognition Based on Combination of Local Features and Globe Information

Feature Level Analysis for 3D Facial Expression Recognition.

3D facial expression recognition using delta faces

Fully automatic 3D facial expression recognition using a region-based approach

An Efficient Multimodal 2D + 3D Feature-Based Approach to Automatic Facial Expression Recognition

Automatic 4D Facial Expression Recognition Using DCT Features

Expression-Robust 3d Face Recognition Using Bending Invariant Correlative Features

3D Facial Expression Recognition Using Deep Feature Fusion CNN

Deep Representation of Facial Geometric and Photometric Attributes for Automatic 3D Facial Expression Recognition

3-D Face Recognition Using Elbp-Based Facial Description and Local Feature Hybrid Matching