Abstract:Dictionary-based classification has been promising in knowledge discovery from image data, due to its good performance and interpretable theoretical system. Dictionary learning effectively supports both small- and large-scale datasets, while its robustness and performance depends on the atoms of the dictionary most of the time. Empirically, using a large number of atoms is helpful to obtain a robust classification, while robustness cannot be ensured when setting a small number of atoms. However, learning a huge dictionary dramatically slows down the speed of classification, which is especially worse on the large-scale datasets. To address the problem, we propose a Fast and Robust Dictionary-based Classification (FRDC) framework, which fully utilizes the learned dictionary for classification by staging - and -norms to obtain a robust sparse representation. The new objective function, on the one hand, introduces an additional -norm term upon the conventional -norm optimization, which generates a more robust classification. On the other hand, the optimization based on both - and -norms is solved in two stages, which is much easier and faster than current solutions. In this way, even when using a limited size of dictionary, which makes sure the classification runs very fast, it still can gain higher robustness for multiple types of image data. The optimization is then theoretically analyzed in a new formulation, close but distinct to elastic-net, to prove it is crucial to improve the performance under the premise of robustness. According to our extensive experiments conducted on four image datasets for face and object classification, FRDC keeps generating a robust classification no matter whether using a small or large number of atoms. This guarantees a fast and robust dictionary-based image classification. Furthermore, when simply using deep features extracted via some popular pre-trained neural networks, it outperforms many state-of-the-art methods on the specific datasets.

Online Robust Dictionary Learning

Online Discriminative Dictionary Learning for Image Classification Based on Block-Coordinate Descent Method

Online Dictionary Learning with Confidence

Robust Visual Tracking Based on Online Learning of Joint Sparse Dictionary.

Robust Graph Dictionary Learning.

A Dual Perspective of Sparse and Robust Online Learning Algorithm

Fast and Robust Dictionary-based Classification for Image Data

Online Kernel Dictionary Learning for Object Recognition

First and Second Order Methods for Online Convolutional Dictionary Learning

Robust Object Tracking Via Constrained Online Dictionary Learning

Learning a Collaborative Multiscale Dictionary Based on Robust Empirical Mode Decomposition

Online Orthogonal Dictionary Learning Based on Frank-Wolfe Method

Online discriminative dictionary learning for robust object tracking.

Robust Learning-Augmented Dictionaries

Joint Augmented and Compressed Dictionaries for Robust Image Classification.

A Non-Convex Relaxation Approach to Sparse Dictionary Learning

Neurogenesis-Inspired Dictionary Learning: Online Model Adaption in a Changing World

Robust Face Recognition Via Discriminative and Common Hybrid Dictionary Learning.

NOODL: Provable Online Dictionary Learning and Sparse Coding

Slice-Based Online Convolutional Dictionary Learning