Abstract:Previous researches have demonstrated that the framework of dictionary learning with sparse coding, in which signals are decomposed as linear combinations of a few atoms of a learned dictionary, is well adept to reconstruction issues. This framework has also been used for discrimination tasks such as image classification. To achieve better performances of classification, experts develop several methods to learn a discriminative dictionary in a supervised manner. However, another issue is that when the data become extremely large in scale, these methods will be no longer effective as they are all batch-oriented approaches. For this reason, we propose a novel online algorithm for discriminative dictionary learning, dubbed \textbf{ODDL} in this paper. First, we introduce a linear classifier into the conventional dictionary learning formulation and derive a discriminative dictionary learning problem. Then, we exploit an online algorithm to solve the derived problem. Unlike the most existing approaches which update dictionary and classifier alternately via iteratively solving sub-problems, our approach directly explores them jointly. Meanwhile, it can largely shorten the runtime for training and is also particularly suitable for large-scale classification issues. To evaluate the performance of the proposed ODDL approach in image recognition, we conduct some experiments on three well-known benchmarks, and the experimental results demonstrate ODDL is fairly promising for image classification tasks.

BSIK-SVD: A dictionary-learning algorithm for block-sparse representations

Online Discriminative Dictionary Learning for Image Classification Based on Block-Coordinate Descent Method

Synthesis K-SVD Based Analysis Dictionary Learning for Pattern Classification

Image Reconstruction Via Small Block-Based Compressed Sensing and Discrete Legendre Polynomials

Sub clustering K-SVD: Size variable dictionary learning for sparse representations

Blockwise Coordinate Descent Schemes for Efficient and Effective Dictionary Learning.

Structured block diagonal representation for subspace clustering

Block Rls Algorithm For Surveillance Video Processing Based On Image Sparse Representation

Block-Diagonal Sparse Representation by Learning a Linear Combination Dictionary for Recognition

Alternating Direction Method of Multipliers for Solving Dictionary Learning Models

Via subspace segmentation for sparse representation

Laplacian Sparse Coding Dictionary for Image Set Based Collaborative Representation

Speaker Recognition Via Block Sparse Bayesian Learning

K-CPD: Learning of Overcomplete Dictionaries for Tensor Sparse Coding.

Blockwise coordinate descent schemes for sparse representation

Learning dictionary via subspace segmentation for sparse representation

Learning Sparse Dictionaries with a Popularity-Based Model

Orthogonal Procrustes Analysis for Dictionary Learning in Sparse Linear Representation

Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis

Subspace Clustering Via Block-Diagonal Decomposition

ODD: an Algorithm of Online Directional Dictionary Learning for Sparse Representation