Abstract:Video-based facial expression recognition (FER) has recently received increased attention as a result of its widespread application. Using only one type of feature to describe facial expression in video sequences is often inadequate, because the information available is very complex. With the emergence of different features to represent different properties of facial expressions in videos, an appropriate combination of these features becomes an important, yet challenging, problem. Considering that the dimensionality of these features is usually high, we thus introduce multiview dimension reduction (MVDR) into video-based FER. In MVDR, it is critical to explore the relationships between and within different feature views. To achieve this goal, we propose a novel framework of MVDR by enforcing joint structured sparsity at both inter- and intraview levels. In this way, correlations on and between the feature spaces of different views tend to be well-exploited. In addition, a transformation matrix is learned for each view to discover the patterns contained in the original features, so that the different views are comparable in finding a common representation. The model can be not only performed in an unsupervised manner, but also easily extended to a semisupervised setting by incorporating some domain knowledge. An alternating algorithm is developed for problem optimization, and each subproblem can be efficiently solved. Experiments on two challenging video-based FER datasets demonstrate the effectiveness of the proposed framework.

Efficient discriminative K-SVD for facial expression recognition

Facial expression recognition based on discriminative dictionary learning

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

A New Fisher Discriminative K-Svd Algorithm For Face Recognition

Learning a Discriminative Dictionary for Facial Expression Recognition.

Discriminative Dictionary Learning Via Fisher Discrimination K-SVD Algorithm

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

Discriminative K-SVD for dictionary learning in face recognition

Facial Expression Recognition with Pyramid Gabor Features and Complete Kernel Fisher Linear Discriminant Analysis

Joint Dimensionality Reduction for Face Recognition Based on D-KSVD.

Dual-graph Regularized Discriminative Transfer Sparse Coding for Facial Expression Recognition

Image-set Based Face Recognition Using K-SVD Dictionary Learning

Discriminant Dictionary Learning with Sparse Embedding on Face Recognition

Learning Kernel Extended Dictionary for Face Recognition

Double Sparse Local Fisher Discriminant Analysis for Facial Expression Recognition

Kernel-based optimized feature vectors selection and discriminant analysis for face recognition

Sparse Representation Classifier Embedding Subspace Mapping and Support Vector for Facial Expression Recognition

Support Vector Discriminant Analysis and Its Application to Facial Expression Recognition

Class specific discriminant dictionary learning with kernels for face recognition

Kernel discriminant analysis based on support vectors