Abstract:The tracking and recognition of facial activities from images or videos have attracted great attention in computer vision field. Facial activities are characterized by three levels. First, in the bottom level, facial feature points around each facial component, i.e., eyebrow, mouth, etc., capture the detailed face shape information. Second, in the middle level, facial action units, defined in the facial action coding system, represent the contraction of a specific set of facial muscles, i.e., lid tightener, eyebrow raiser, etc. Finally, in the top level, six prototypical facial expressions represent the global facial muscle movement and are commonly used to describe the human emotion states. In contrast to the mainstream approaches, which usually only focus on one or two levels of facial activities, and track (or recognize) them separately, this paper introduces a unified probabilistic framework based on the dynamic Bayesian network to simultaneously and coherently represent the facial evolvement in different levels, their interactions and their observations. Advanced machine learning methods are introduced to learn the model based on both training data and subjective prior knowledge. Given the model and the measurements of facial motions, all three levels of facial activities are simultaneously recognized through a probabilistic inference. Extensive experiments are performed to illustrate the feasibility and effectiveness of the proposed model on all three level facial activities.

From Rank-N to Rank-1 Face Recognition Based on Motion Similarity.

Face Recognition Based on Non-local Similarity Dictionary.

Learning a Locality Preserving Subspace for Visual Recognition.

Advances in Moving Face Recognition

Face Recognition based on scale invariant feature transform and Spatial Pyramid Representation

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Robust 3D Face Recognition by Local Shape Difference Boosting

Face identification using reference-based features with message passing model

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

A Face Recognition Workflow Based Upon Similarity Measurement.

Quo Vadis RankList-based System in Face Recognition?

Mutimodal Ranking Optimization for Heterogeneous Face Re-identification

Maximizing Intra-Individual Correlations for Face Recognition Across Pose Differences.

Face Recognition under Occlusions and Variant Expressions with Partial Similarity

Face recognition using neighborhood preserving projections

Face Recognition Based on Face‐specific Subspace

Domain-invariant Face Recognition using Learned Low-rank Transformation

Rapid and brief communication: Intrapersonal subspace analysis with application to adaptive Bayesian face recognition

Face Recognition Using Nonlinear Partial Least Squares in Reproducing Kernel Hilbert Space

Simultaneous Facial Feature Tracking and Facial Expression Recognition.

Expression recognition from 3D dynamic faces using robust spatio-temporal shape features