Abstract:Facial expression which carries rich information of body behavior is the leading carrier of human affective and the symbol of intelligence. The main purpose of this paper is to recognize 3D human facial expression. The research in this paper includes the expression feature extraction algorithm and fusion with different kinds of feature. To contain more local texture feature information, we proposed a new feature of 3D facial expression named Local Threshold Binary Pattern (LTBP) which based on Local Binary Pattern (LBP). We calculate the difference of gray value standard between neighboring pixels and the center pixel as a threshold to binary instead of the traditional LBP operation which only comparison of size between neighboring pixels and the center pixel. After we get the LTBP feature, we fuse the LTBP and HOG (Histogram of Oriented Gradient) features to get multi-feature fusion for 3D facial expression recognition. Our algorithm of 3D facial expression recognition comprises three steps: (1) extracting two sets of feature vectors and establishing the correlation criterion function between the two sets of feature vectors; (2) solving the two sets canonical projective vectors and extracting their canonical correlation features by the framework of canonical correlation analysis algorithm; (3) doing feature fusion for classification by using proposed strategy. We have performed comprehensive experiments on the BU-3DFE database which is presently the largest available 3D face database. We have achieved verification rates of more than 90% for the 3D facial expression recognition.

A novel approach to enhance automatic 3D facial expression recognition

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Fully Automatic 3D Facial Expression Recognition Using Polytypic Multi-Block Local Binary Patterns

Multiple Strategies to Enhance Automatic 3D Facial Expression Recognition

Automatic 3D facial expression recognition based on polytypic Local Binary Pattern

Fully Automatic 3D Facial Expression Recognition Using Local Depth Features

An Efficient Multimodal 2D + 3D Feature-Based Approach to Automatic Facial Expression Recognition

3D Facial Expression Recognition Using Distance Features and LBP Features Based on Automatically Detected Keypoints

3D facial expression recognition using delta faces

3D Facial Expression Recognition Algorithm Using Local Threshold Binary Pattern and Histogram of Oriented Gradient

Fully automatic 3D facial expression recognition using a region-based approach

Three-dimensional face recognition under expression variation

Deep Representation of Facial Geometric and Photometric Attributes for Automatic 3D Facial Expression Recognition

Automatic 4D Facial Expression Recognition Using DCT Features

An Optimal Transportation-Based Recognition Algorithm for 3D Facial Expressions

A novel approach to expression recognition from non-frontal face images.

Enhancing Facial Classification and Recognition using 3D Facial Models and Deep Learning

3D/4D Facial Expression Analysis: an Advanced Annotated Face Model Approach

Automatic 3D Facial Expression Recognition Based on a Bayesian Belief Net and a Statistical Facial Feature Model

Automatic 3D Facial Expression Recognition Using Geometric Scattering Representation

Feature Level Analysis for 3D Facial Expression Recognition.