Abstract:Automatic facial expression analysis has received great attention in different applications over the last two decades. Facial Action Coding System (FACS), which describes all possible facial expressions based on a set of facial muscle movements called Action Unit (AU), has been used extensively to model and analyze facial expressions. FACS describes methods for coding the intensity of AUs, and AU intensity measurement is important in some studies in behavioral science and developmental psychology. However, in majority of the existing studies in the area of facial expression recognition, the focus has been on basic expression recognition or facial action unit detection. There are very few investigations on measuring the intensity of spontaneous facial actions. In addition, the few studies on AU intensity recognition usually try to measure the intensity of facial actions statically and individually, ignoring the dependencies among multilevel AU intensities as well as the temporal information. However, these spatiotemporal interactions among facial actions are crucial for understanding and analyzing spontaneous facial expressions, since these coherent, coordinated, and synchronized interactions are that produce a meaningful facial display. In this paper, we propose a framework based on Dynamic Bayesian Network (DBN) to systematically model the dynamic and semantic relationships among multilevel AU intensities. Given the extracted image observations, the AU intensity recognition is accomplished through probabilistic inference by systematically integrating the image observations with the proposed DBN model. Experiments on Denver Intensity of Spontaneous Facial Action (DISFA) database demonstrate the superiority of our method over single image-driven methods in AU intensity measurement.

A Novel Dynamic Model Capturing Spatial and Temporal Patterns for Facial Expression Analysis

Capturing Spatial and Temporal Patterns for Distinguishing Between Posed and Spontaneous Expressions

Capturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition

Posed and Spontaneous Expression Recognition Through Restricted Boltzmann Machine.

Video-driven state-aware facial animation

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

3D Facial Expression Editing Based on the Dynamic Graph Model

A Spatio-Temporal Integrated Model Based on Local and Global Features for Video Expression Recognition

Multiple Facial Action Unit Recognition Enhanced by Facial Expressions.

Facial Expression Recognition Through Modeling Age-Related Spatial Patterns.

Modeling the Correlation Between Modality Semantics and Facial Expressions

High Resolution Acquisition, Learning And Transfer Of Dynamic 3-D Facial Expressions

3D/4D Facial Expression Analysis: an Advanced Annotated Face Model Approach

Measuring the intensity of spontaneous facial action units with dynamic Bayesian network

A Facial Expression Model For Human-Like Agent

Posed and Spontaneous Expression Distinction Using Latent Regression Bayesian Networks

Dynamic Facial Expression Recognition Using A Bayesian Temporal Manifold Model

Fine-Grained Facial Expression Analysis Using Dimensional Emotion Model

Facial Expression Recognition Based on Deep Evolutional Spatial-Temporal Networks

Facial Expression Representation Based on Timing Structures in Faces