Abstract:Sparse representation is a mathematical model for data representation that has proved to be a powerful tool for solving problems in various fields such as pattern recognition, machine learning, and computer vision. As one of the building blocks of the sparse representation method, dictionary learning plays an important role in the minimization of the reconstruction error between the original signal and its sparse representation in the space of the learned dictionary. Although using training samples directly as dictionary bases can achieve good performance, the main drawback of this method is that it may result in a very large and inefficient dictionary due to noisy training instances. To obtain a smaller and more representative dictionary, in this paper, we propose an approach called Laplacian sparse dictionary (LSD) learning. Our method is based on manifold learning and double sparsity. We incorporate the Laplacian weighted graph in the sparse representation model and impose the l1-norm sparsity on the dictionary. An LSD is a sparse overcomplete dictionary that can preserve the intrinsic structure of the data and learn a smaller dictionary for each class. The learned LSD can be easily integrated into a classification framework based on sparse representation. We compare the proposed method with other methods using three benchmark-controlled face image databases, Extended Yale B, ORL, and AR, and one uncontrolled person image dataset, i-LIDS-MA. Results show the advantages of the proposed LSD algorithm over state-of-the-art sparse representation based classification methods.

Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis

Dictionary learning for sparse representation: Complexity and algorithms

K-CPD: Learning of Overcomplete Dictionaries for Tensor Sparse Coding.

Blockwise Coordinate Descent Schemes for Efficient and Effective Dictionary Learning.

Kernel Regularized Nonlinear Dictionary Learning for Sparse Coding

Dictionary learning under global sparsity constraint

Discriminant sparse coding for image classification

Bayesian sparsity and class sparsity priors for dictionary learning and coding

Online Convolutional Sparse Coding with Sample-Dependent Dictionary

Convergence Analysis for Deep Sparse Coding via Convolutional Neural Networks

A Non-Convex Relaxation Approach to Sparse Dictionary Learning

Efficient ADMM-based Algorithms for Convolutional Sparse Coding

Learning Sparsely Used Overcomplete Dictionaries via Alternating Minimization

L0 Norm Based Dictionary Learning by Proximal Methods with Global Convergence

Dictionary learning for fast classification based on soft-thresholding

Robust Kernel Dictionary Learning Using a Whole Sequence Convergent Algorithm.

Sparse Coding and Dictionary Learning for Symmetric Positive Definite Matrices: A Kernel Approach

Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

Laplacian Sparse Coding Dictionary for Image Set Based Collaborative Representation

Sparse Coding and Dictionary Learning with Linear Dynamical Systems.

Dictionary Learning and Sparse Coding on Grassmann Manifolds: an Extrinsic Solution