Abstract: This work investigates the problem of efficiently learning discriminative low-dimensional representations of multiclass large-scale image objects. We propose a generic deep learning approach by taking advantages of Convolutional Neural Networks (CNN), sparse dictionary learning, and orthogonal projections. CNN is not only powerful on feature extraction, but also robust to spatial variance and changes. Sparse dictionary learning is well known for disentangling nonlinear underlying discriminative factors in data. The orthogonal projection is a notable efficient tool to project multi-class data onto low dimensional discriminative subspace. The proposed procedure can be summarized as follows. At first, a CNN is employed to extract high-dimensional (HD) preliminary convolutional features. Secondly, to avoid the high computational cost of direct sparse coding on HD CNN features, we present to learn sparse representation (SR) in an orthogonal projected space over a taskdriven sparsifying dictionary. We then exploit the discriminative projection on SR. The whole learning process is treated as a joint optimization problem of trace quotient maximization, which involves the CNN parameters, the orthogonal projection on CNN features, the dictionary and the discriminative projection on sparse codes. The related cost function is well defined on product manifold of the Stiefel manifold, the Oblique manifold, and the Grassmann manifold. It is optimized via a geometrical stochastic gradient descent algorithm. Finally, the quality of dictionary and projections learned by the proposed approach is further investigated in terms of image classification. The experimental results show that the approach can achieve a strongly competitive performance with state-of-the-art image classification methods.

Integrating Convolution and Sparse Coding for Learning Low-Dimensional Discriminative Image Representations

Joint Learning of Discriminative Low-dimensional Image Representations Based on Dictionary Learning and Two-layer Orthogonal Projections

Joint Learning Dictionary and Discriminative Features for High Dimensional Data.

Joint Learning Sparsifying Linear Transformation for Low-Resolution Image Synthesis and Recognition

Image Classification by Non-Negative Sparse Coding, Low-Rank and Sparse Decomposition

Self-Explanatory Convex Sparse Representation for Image Classification

Image Classification by Non-Negative Sparse Coding, Correlation Constrained Low-Rank and Sparse Decomposition.

Learning a Discriminative Dictionary with CNN for Image Classification.

Discriminative Sparse Neighbor Coding.

Discriminant sparse coding for image classification

Learning Discriminative Dictionary for Group Sparse Representation.

A linear subspace learning approach via sparse coding

Low-Rank Sparse Coding for Image Classification

Multi-level Discriminative Dictionary Learning with Application to Large Scale Image Classification.

A Convolutional Neural Network with Sparse Representation

Hierarchical Discriminative Sparse Coding Via Bidirectional Connections

Fostering Sparsity in Sparse Convolution Networks for Efficient 3D Perception via Feature-Guidance

Fine-Grained Image Classification Via Low-Rank Sparse Coding with General and Class-Specific Codebooks.

Convergence Analysis for Deep Sparse Coding via Convolutional Neural Networks

Joint Low-Rank and Sparse Principal Feature Coding for Enhanced Robust Representation and Visual Classification

Learning a Multi-class Discriminative Dictionary with Nonredundancy Constraints for Visual Classification