Abstract:Classifiers based on sparse representations have recently been shown to provide excellent results in many visual recognition and classification tasks. However, the high cost of computing sparse representations at test time is a major obstacle that limits the applicability of these methods in large-scale problems, or in scenarios where computational power is restricted. We consider in this paper a simple yet efficient alternative to sparse coding for feature extraction. We study a classification scheme that applies the soft-thresholding nonlinear mapping in a dictionary, followed by a linear classifier. A novel supervised dictionary learning algorithm tailored for this low complexity classification architecture is proposed. The dictionary learning problem, which jointly learns the dictionary and linear classifier, is cast as a difference of convex (DC) program and solved efficiently with an iterative DC solver. We conduct experiments on several datasets, and show that our learning algorithm that leverages the structure of the classification problem outperforms generic learning procedures. Our simple classifier based on soft-thresholding also competes with the recent sparse coding classifiers, when the dictionary is learned appropriately. The adopted classification scheme further requires less computational time at the testing stage, compared to other classifiers. The proposed scheme shows the potential of the adequately trained soft-thresholding mapping for classification and paves the way towards the development of very efficient classification methods for vision problems.

Dictionary learning for sparse representation: Complexity and algorithms

Sparse Representation over Overcomplete Dictionary Based on Bayesian Nonparametric Approximation

Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis

Incoherent Dictionary Learning for Sparse Representation Based Image Denoising

An Efficient Dictionary Learning Algorithm for Sparse Representation

A Non-Convex Relaxation Approach to Sparse Dictionary Learning

A Novel Dictionary Design Algorithm for Sparse Representations

Image Denoising Based on Learning Over-Complete Dictionary.

Dictionary learning under global sparsity constraint

Learning Block-Structured Incoherent Dictionaries for Sparse Representation

Image denoising based on adaptive over-complete sparse representation

Dictionary Learning Research Based on Sparse Representation

Dictionary Learning With Log-Regularizer For Sparse Representation

Blockwise Coordinate Descent Schemes for Efficient and Effective Dictionary Learning.

Learning dictionary via subspace segmentation for sparse representation

Dictionary learning for fast classification based on soft-thresholding

Learning Stable Multilevel Dictionaries for Sparse Representations

A Fast Algorithm for Learning Overcomplete Dictionary for Sparse Representation Based on Proximal Operators

An efficient learned dictionary and its application to non-local denoising

Learning Overcomplete Dictionaries with Application to Image Denoising

Dictionary Learning for Sparse Representation Using Weighted ℓ<inf>1</inf>-Norm