Abstract:Video-based facial expression recognition (FER) has recently received increased attention as a result of its widespread application. Using only one type of feature to describe facial expression in video sequences is often inadequate, because the information available is very complex. With the emergence of different features to represent different properties of facial expressions in videos, an appropriate combination of these features becomes an important, yet challenging, problem. Considering that the dimensionality of these features is usually high, we thus introduce multiview dimension reduction (MVDR) into video-based FER. In MVDR, it is critical to explore the relationships between and within different feature views. To achieve this goal, we propose a novel framework of MVDR by enforcing joint structured sparsity at both inter- and intraview levels. In this way, correlations on and between the feature spaces of different views tend to be well-exploited. In addition, a transformation matrix is learned for each view to discover the patterns contained in the original features, so that the different views are comparable in finding a common representation. The model can be not only performed in an unsupervised manner, but also easily extended to a semisupervised setting by incorporating some domain knowledge. An alternating algorithm is developed for problem optimization, and each subproblem can be efficiently solved. Experiments on two challenging video-based FER datasets demonstrate the effectiveness of the proposed framework.

Spatially Adaptive Logarithmic Total Variation Model for Varying Light Face Recognition

Learning a Locality Preserving Subspace for Visual Recognition.

Robust spectral regression for face recognition

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

Adaptive Illumination Normalization Via Adaptive Illumination Preprocessing and Modified Weber-Face

Face Recognition under Varying Illumination Based on Gradientface and Local Features

Multiscale logarithm difference edgemaps for face recognition against varying lighting conditions

Exploring Illumination Removal of Face Image Via Logarithmic Gradient Penalty for Accurate Facial Expression Recognition

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

Contrastive Learning with Hallucinating Data for Long-Tailed Face Recognition.

Illumination Variation Dictionary Designing for Single-Sample Face Recognition via Sparse Representation

Facial Landmark Disentangled Network with Variational Autoencoder

Variational Retinex Model Based on an Extension of TV Regularization with Relative Gradient and Its Application

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Illumination invariant single face image recognition under heterogeneous lighting condition

Log-domain Polynomial Filters for Illumination-Robust Face Recognition

Extraction of illumination invariant facial features from a single image using nonsubsampled contourlet transform

Low-Light Video Enhancement via Spatial-Temporal Consistent Illumination and Reflection Decomposition