Abstract:Video-based facial expression recognition (FER) has recently received increased attention as a result of its widespread application. Using only one type of feature to describe facial expression in video sequences is often inadequate, because the information available is very complex. With the emergence of different features to represent different properties of facial expressions in videos, an appropriate combination of these features becomes an important, yet challenging, problem. Considering that the dimensionality of these features is usually high, we thus introduce multiview dimension reduction (MVDR) into video-based FER. In MVDR, it is critical to explore the relationships between and within different feature views. To achieve this goal, we propose a novel framework of MVDR by enforcing joint structured sparsity at both inter- and intraview levels. In this way, correlations on and between the feature spaces of different views tend to be well-exploited. In addition, a transformation matrix is learned for each view to discover the patterns contained in the original features, so that the different views are comparable in finding a common representation. The model can be not only performed in an unsupervised manner, but also easily extended to a semisupervised setting by incorporating some domain knowledge. An alternating algorithm is developed for problem optimization, and each subproblem can be efficiently solved. Experiments on two challenging video-based FER datasets demonstrate the effectiveness of the proposed framework.

Distribution Regularized Nonnegative Matrix Factorization for Transfer Visual Feature Learning

Feature Extraction Via Multi-View Non-Negative Matrix Factorization with Local Graph Regularization.

Cross-domain Residual Deep NMF for Transfer Learning Between Different Hyperspectral Image Scenes.

Multi-layer Cross-domain Non-negative Matrix Factorization for Cross-scene Dimension Reduction on Hyperspectral Images.

Robust discriminative non-negative matrix factorization.

Learning Parts-Based and Global Representation for Image Classification.

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Discriminative Concept Factorization for Data Representation

Robust Nonnegative Matrix Factorization with Discriminability for Image Representation

Adaptive graph regularized nonnegative matrix factorization for data representation

Scalable Linear Visual Feature Learning Via Online Parallel Nonnegative Matrix Factorization

Robust Structured Nonnegative Matrix Factorization for Image Representation.

Image Representation Using Laplacian Regularized Nonnegative Tensor Factorization

Image Feature Extraction via Graph Embedding Regularized Projective Non-negative Matrix Factorization.

Nonnegative Discriminant Matrix Factorization

Centric graph regularized log-norm sparse non-negative matrix factorization for multi-view clustering

Correntropy Supervised Non-Negative Matrix Factorization

Discriminative Orthogonal Nonnegative Matrix Factorization with Flexibility for Data Representation

Constrained Nonnegative Matrix Factorization for Image Representation

Manifold Transfer Learning via Discriminant Regression Analysis

Semi-supervised Convex Nonnegative Matrix Factorizations with Graph Regularized for Image Representation