Abstract:At present, dictionary based models have been widely used in image classification. The image features are approximated as a linear combination of bases selected from the dictionary in a sparse space, resulting in compact patterns. The features applied to image classification usually reside on low dimensional manifolds embedded in a high dimensional ambient space; traditional sparse coding algorithm, however, does not consider this topological structure. It can be characterized naturally by linear coefficients that reconstruct each data point from its neighbors. One of the central issues here is how to determine the neighbors and learn the coefficients. In this paper, the geometrical structures are encoded in two situations. In simple cases when data points distribute on a single manifold, it is explicitly modeled by locally linear embedding algorithm combined with k-nearest neighbors. Nevertheless, in real-world scenarios, complex data points often lie on multiple manifolds. Sparse representation algorithm combined with k-nearest neighbors is instead utilized to construct the topological structures, because it is capable of approximating the data point by selecting its homogenous neighbors adaptively to guarantee the smoothness of each manifold. After obtaining the local fitting relationship, these two topological structures are then embedded into sparse coding algorithm as regularization terms to formulate the corresponding objective functions of dictionary learning on single manifold (DLSM) and dictionary learning on multiple manifolds (DLMM), respectively. Upon this, a coordinate descent scheme is proposed to solve the unified optimization problems. Experimental results on several benchmark data sets, such as Caltech-256, Caltech-101, Scene 15, and UIUC-Sports, show that our proposed algorithms equal or outperform other state-of-the-art image classification algorithms.

K-Deep Simplex: Deep Manifold Learning via Local Dictionaries

Locality Pursuit Embedding

Deep Manifold Computing and Visualization

Learning Dictionary on Manifolds for Image Classification

Weighed l1 on the simplex: Compressive sensing meets locality

Dictionary Learning and Sparse Coding on Grassmann Manifolds: an Extrinsic Solution

DIMAL: Deep Isometric Manifold Learning Using Sparse Geodesic Sampling

Majorization Minimization Technique for Optimally Solving Deep Dictionary Learning

Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

Low-Rank Plus Sparse Reconstruction Using Dictionary Learning for 3D-Mri

Locality Constrained Analysis Dictionary Learning via K-SVD Algorithm

Dictionary Learning for Two-Dimensional Kendall Shapes

Dictionary Learning on Multiple Manifolds for Image Classification

Twin-Incoherent Self-Expressive Locality-Adaptive Latent Dictionary Pair Learning for Classification

Learning Stable Multilevel Dictionaries for Sparse Representations

Low Rank Multi-Dictionary Selection at Scale

Denoising and Completion of 3D Data via Multidimensional Dictionary Learning

Efficient Representation of Low-Dimensional Manifolds using Deep Networks

Row-Sparse Discriminative Deep Dictionary Learning for Hyperspectral Image Classification

Deep Encoders with Auxiliary Parameters for Extreme Classification.

An Over Complete Deep Learning Method for Inverse Problems