Abstract:We present a dictionary learning approach to compensate for the transformation of faces due to the changes in view point, illumination, resolution, and so on. The key idea of our approach is to force domain-invariant sparse coding, i.e., designing a consistent sparse representation of the same face in different domains. In this way, the classifiers trained on the sparse codes in the source domain consisting of frontal faces can be applied to the target domain (consisting of faces in different poses, illumination conditions, and so on) without much loss in recognition accuracy. The approach is to first learn a domain base dictionary, and then describe each domain shift (identity, pose, and illumination) using a sparse representation over the base dictionary. The dictionary adapted to each domain is expressed as the sparse linear combinations of the base dictionary. In the context of face recognition, with the proposed compositional dictionary approach, a face image can be decomposed into sparse representations for a given subject, pose, and illumination. This approach has three advantages. First, the extracted sparse representation for a subject is consistent across domains, and enables pose and illumination insensitive face recognition. Second, sparse representations for pose and illumination can be subsequently used to estimate the pose and illumination condition of a face image. Last, by composing sparse representations for the subject and the different domains, we can also perform pose alignment and illumination normalization. Extensive experiments using two public face data sets are presented to demonstrate the effectiveness of the proposed approach for face recognition.

Compositional Models and Structured Learning for Visual Recognition

Discovering Commonness and Specificness for Human Action Recognition.

Compositional Structure Learning for Action Understanding

Supervised class-specific dictionary learning for sparse modeling in action recognition

Discriminative-Element-Aware Sparse Representation for Action Recognition

Constructing Visual Vocabularies Using Sparse Coding for Action Recognition

Sparse Coding on Local Spatial-Temporal Volumes for Human Action Recognition

Learning Universal Multiview Dictionary for Human Action Recognition.

Learning sparse representations for human action recognition

Unsupervised learning of compositional sparse code for natural image representation

Action Recognition by Joint Learning

Action Recognition Using Nonnegative Action Component Representation and Sparse Basis Selection

Action Recognition Via Structured Codebook Construction

Action Recognition Using Low-Rank Sparse Representation

Learning Latent Spatio-Temporal Compositional Model for Human Action Recognition

Commonly Uncommon: Semantic Sparsity in Situation Recognition

Learning a Discriminative Feature Descriptor with Sparse Coding for Action Recognition

Compositional Dictionaries for Domain Adaptive Face Recognition

A Joint Evaluation of Dictionary Learning and Feature Encoding for Action Recognition.

Exploiting Structure Sparsity for Covariance-based Visual Representation