Abstract:The inherent dependencies among facial action units (AUs) caused by the underlying anatomic mechanism are essential for the proper recognition of AUs and the estimation of intensity levels, but they have not been exploited to their full potential. We are proposing novel methods to recognize AUs and estimate intensity via hybrid Bayesian networks (BNs). The upper two layers are latent regression BNs (LRBNs), and the lower layers are BNs. The visible nodes of the LRBN layers are the representations of ground-truth AU occurrences or AU intensities. Through the directed connections from latent layer and visible layer, an LRBN can successfully represent relationships between multiple AUs or AU intensities. The lower layers include BNs with two nodes for AU recognition, and BNs with three nodes for AU intensity estimation. The bottom layers incorporate measurements from facial images with AU dependencies for intensity estimation and AU recognition. Efficient learning algorithms of the hybrid Bayesian networks are proposed for AU recognition as well as intensity estimation. Furthermore, the proposed hybrid BN models are extended for facial expression-assisted AU recognition and intensity estimation, as AU relationships are closely related to facial expressions. We test our methods on three benchmark databases for AU recognition and two benchmark databases for intensity estimation. The results demonstrate that the proposed approaches faithfully model the complex and global inherent AU dependencies, and the expression labels available only during training can boost the estimation of AU dependencies for both AU recognition and intensity estimation.

Posed and Spontaneous Expression Distinction Using Latent Regression Bayesian Networks

Differentiating Between Posed And Spontaneous Expressions With Latent Regression Bayesian Network

Posed and Spontaneous Expression Recognition Through Modeling Their Spatial Patterns

Analyses of the Differences between Posed and Spontaneous Facial Expressions

Capturing Spatial and Temporal Patterns for Distinguishing Between Posed and Spontaneous Expressions

Posed and Spontaneous Expression Recognition Through Restricted Boltzmann Machine.

An Interpretable Deep Bayesian Model for Facial Micro-Expression Recognition

Capturing Global Spatial Patterns for Distinguishing Posed and Spontaneous Expressions

A Novel Dynamic Model Capturing Spatial and Temporal Patterns for Facial Expression Analysis

Convolutional Neural Networks for Posed and Spontaneous Expression Recognition

Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework

Posed and spontaneous facial expression differentiation using deep Boltzmann machines

Capturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition

Facial Expression Recognition Through Modeling Age-Related Spatial Patterns.

Spontaneous Versus Posed Smile Recognition Using Discriminative Local Spatial-Temporal Descriptors

Spontaneous facial expression recognition: A robust metric learning approach

Facial Action Unit Recognition and Intensity Estimation Enhanced Through Label Dependencies

Facial Emotion and Action Unit Recognition Based on Bayesian Network.

Using Attention Lsgb Network for Facial Expression Recognition

Posed and spontaneous expression distinguishment from infrared thermal images

Improving Limited Resource Speech Recognition Performance with Latent Regression Bayesian Network