Abstract:Automatic facial expression analysis has received great attention in different applications over the last two decades. Facial Action Coding System (FACS), which describes all possible facial expressions based on a set of facial muscle movements called Action Unit (AU), has been used extensively to model and analyze facial expressions. FACS describes methods for coding the intensity of AUs, and AU intensity measurement is important in some studies in behavioral science and developmental psychology. However, in majority of the existing studies in the area of facial expression recognition, the focus has been on basic expression recognition or facial action unit detection. There are very few investigations on measuring the intensity of spontaneous facial actions. In addition, the few studies on AU intensity recognition usually try to measure the intensity of facial actions statically and individually, ignoring the dependencies among multilevel AU intensities as well as the temporal information. However, these spatiotemporal interactions among facial actions are crucial for understanding and analyzing spontaneous facial expressions, since these coherent, coordinated, and synchronized interactions are that produce a meaningful facial display. In this paper, we propose a framework based on Dynamic Bayesian Network (DBN) to systematically model the dynamic and semantic relationships among multilevel AU intensities. Given the extracted image observations, the AU intensity recognition is accomplished through probabilistic inference by systematically integrating the image observations with the proposed DBN model. Experiments on Denver Intensity of Spontaneous Facial Action (DISFA) database demonstrate the superiority of our method over single image-driven methods in AU intensity measurement.

Facial Emotion and Action Unit Recognition Based on Bayesian Network.

Facial Action Unit Recognition and Intensity Estimation Enhanced Through Label Dependencies

Knowledge Augmented Deep Neural Networks for Joint Facial Expression and Action Unit Recognition.

An Action Unit Co-Occurrence Constraint 3DCNN Based Action Unit Recognition Approach.

Faceknow: Facial Expression Recognition by a Global-Local Network with a Sub-Images-Related Contextual Attention Mechanism

Facial Action Unit Classification with Hidden Knowledge under Incomplete Annotation

Multiple Facial Action Unit Recognition Enhanced by Facial Expressions.

An Interpretable Deep Bayesian Model for Facial Micro-Expression Recognition

Using Feature Points and Angles Between Them to Recognise Facial Expression by a Neural Network Approach

Capture expression-dependent AU relations for expression recognition

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

A Unified Probabilistic Framework for Automatic 3D Facial Expression Analysis Based on a Bayesian Belief Inference and Statistical Feature Models

Facial Action Units Recognition: A Comparative Study

Deep Structure Inference Network for Facial Action Unit Recognition

Deep-block Network for AU Recognition and Expression Migration

Attention mechanism-based CNN for facial expression recognition

Automatic 3D Facial Expression Recognition Based on a Bayesian Belief Net and a Statistical Facial Feature Model

Expression-assisted Facial Action Unit Recognition under Incomplete AU Annotation.

AU-aware Deep Networks for Facial Expression Recognition

Bayesian Convolutional Neural Networks for Seven Basic Facial Expression Classifications

Measuring the intensity of spontaneous facial action units with dynamic Bayesian network