Abstract:ABSTRACTFacial expression recognition has many applications in multimedia processing and the development of 3D data acquisition techniques makes it possible to identify expressions using 3D shape information. In this paper, we propose an automatic facial expression recognition approach based on a single 3D face. The shape of an expressional 3D face is approximated as the sum of two parts, a basic facial shape component (BFSC) and an expressional shape component (ESC). The BFSC represents the basic face structure and neutral-style shape and the ESC contains shape changes caused by facial expressions. To separate the BFSC and ESC, our method firstly builds a reference face for each input 3D non-neutral face by a learning method, which well represents the basic facial shape. Then, based on the BFSC and the original expressional face, a facial expression descriptor is designed. The surface depth changes are considered in the descriptor. Finally, the descriptor is input into an SVM to recognize the expression. Unlike previous methods which recognize a facial expression with the help of manually labeled key points and/or a neutral face, our method works on a single 3D face without any manual assistance. Extensive experiments are carried out on the BU-3DFE database and comparisons with existing methods are conducted. The experimental results show the effectiveness of our method.

A Novel Method Of Extracting Facial Feature Points Based On 3d Rotation And Asm

Facial Features Extraction Based on Active Shape Model.

Facial Feature Localization Using Robust Active Shape Model and POEM Descriptors

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

Fast face modeling based on features and flexible mesh model

Face Feature Points Extraction Based on Refined ASM

Method for Extracting 3D Facial Feature

Automatic 3D Face Modeling Using 2D Active Appearance Models

A Novel Facial Feature Point Localization Method on 3D Faces

Facial Feature Localization Based on an Improved Active Shape Model

3D Face Reconstruction Based on Geometric Transformation

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Realistic Reconstruction of Human Face Based on Images

Approach of Human Face Recognition Based on SIFT Feature Extraction and 3D Rotation Model

Research on Facial Feature Points Extraction in Color Images

A synthesis method for personalized 3D face reconstruction

Extended Fitting Methods of Active Shape Model for the Location of Facial Feature Points

An Improved Active Shape Model Application on Facial Feature Localization

3-D Face Structure Extraction Using Shape Matching Morphing Model

Reshaping 3D Facial Scans for Facial Appearance Modeling and 3D Facial Expression Analysis

A NEW FACE FEATURE POINT MATRIX BASED ON GEOMETRIC FEATURES AND ILLUMINATION MODELS FOR FACIAL ATTRACTION ANALYSIS