Learning dictionary on manifolds for image classification

LiuBao-Di,WangYu-Xiong,ZhangYu-Jin,ShenBin

IF: 8

2013-01-01

Pattern Recognition

Abstract:At present, dictionary based models have been widely used in image classification. The image features are approximated as a linear combination of bases selected from the dictionary in a sparse spac...

What problem does this paper attempt to address?

Learning Dictionary on Manifolds for Image Classification

Bao-Di Liu,Yu-Xiong Wang,Yu-Jin Zhang,Bin Shen

DOI: https://doi.org/10.1016/j.patcog.2012.11.018

IF: 8

2013-01-01

Pattern Recognition

Abstract:At present, dictionary based models have been widely used in image classification. The image features are approximated as a linear combination of bases selected from the dictionary in a sparse space, resulting in compact patterns. The features applied to image classification usually reside on low dimensional manifolds embedded in a high dimensional ambient space; traditional sparse coding algorithm, however, does not consider this topological structure. It can be characterized naturally by linear coefficients that reconstruct each data point from its neighbors. One of the central issues here is how to determine the neighbors and learn the coefficients. In this paper, the geometrical structures are encoded in two situations. In simple cases when data points distribute on a single manifold, it is explicitly modeled by locally linear embedding algorithm combined with k-nearest neighbors. Nevertheless, in real-world scenarios, complex data points often lie on multiple manifolds. Sparse representation algorithm combined with k-nearest neighbors is instead utilized to construct the topological structures, because it is capable of approximating the data point by selecting its homogenous neighbors adaptively to guarantee the smoothness of each manifold. After obtaining the local fitting relationship, these two topological structures are then embedded into sparse coding algorithm as regularization terms to formulate the corresponding objective functions of dictionary learning on single manifold (DLSM) and dictionary learning on multiple manifolds (DLMM), respectively. Upon this, a coordinate descent scheme is proposed to solve the unified optimization problems. Experimental results on several benchmark data sets, such as Caltech-256, Caltech-101, Scene 15, and UIUC-Sports, show that our proposed algorithms equal or outperform other state-of-the-art image classification algorithms.
Dictionary Learning on Multiple Manifolds for Image Classification

Yujin Zhang

2012-01-01

Abstract:Traditional image classification algorithms based on sparse coding do not consider the relationships among different features.A dictionary learning algorithm was developed to overcome this shortcoming,in which the intrinsic geometrical structure of the multiple manifolds explicitly models the features embedded into a sparse coding algorithm.A coordinate descent algorithm was then used to solve the optimization problem.A convergence analysis was given that shows the algorithm will converge.Tests on three standard benchmark datasets show that the algorithm outperforms other state-of-the-art image classification algorithms.
Online Discriminative Dictionary Learning for Image Classification Based on Block-Coordinate Descent Method

Shu Kong,Donghui Wang

DOI: https://doi.org/10.48550/arxiv.1203.0856

2012-01-01

Abstract:Previous researches have demonstrated that the framework of dictionary learning with sparse coding, in which signals are decomposed as linear combinations of a few atoms of a learned dictionary, is well adept to reconstruction issues. This framework has also been used for discrimination tasks such as image classification. To achieve better performances of classification, experts develop several methods to learn a discriminative dictionary in a supervised manner. However, another issue is that when the data become extremely large in scale, these methods will be no longer effective as they are all batch-oriented approaches. For this reason, we propose a novel online algorithm for discriminative dictionary learning, dubbed \textbf{ODDL} in this paper. First, we introduce a linear classifier into the conventional dictionary learning formulation and derive a discriminative dictionary learning problem. Then, we exploit an online algorithm to solve the derived problem. Unlike the most existing approaches which update dictionary and classifier alternately via iteratively solving sub-problems, our approach directly explores them jointly. Meanwhile, it can largely shorten the runtime for training and is also particularly suitable for large-scale classification issues. To evaluate the performance of the proposed ODDL approach in image recognition, we conduct some experiments on three well-known benchmarks, and the experimental results demonstrate ODDL is fairly promising for image classification tasks.
A Classification-Oriented Dictionary Learning Model: Explicitly Learning the Particularity and Commonality Across Categories.

Donghui Wang,Shu Kong

DOI: https://doi.org/10.1016/j.patcog.2013.08.004

IF: 8

2013-01-01

Pattern Recognition

Abstract:Empirically, we find that despite the most exclusively discriminative features owned by one specific object category, the various classes of objects usually share some common patterns, which do not contribute to the discrimination of them. Concentrating on this observation and motivated by the success of dictionary learning (DL) framework, in this paper, we propose to explicitly learn a class-specific dictionary (called particularity) for each category that captures the most discriminative features of this category, and simultaneously learn a common pattern pool (called commonality), whose atoms are shared by all the categories and only contribute to representation of the data rather than discrimination. In this way, the particularity differentiates the categories while the commonality provides the essential reconstruction for the objects. Thus, we can simply adopt a reconstruction-based scheme for classification. By reviewing the existing DL-based classification methods, we can see that our approach simultaneously learns a classification-oriented dictionary and drives the sparse coefficients as discriminative as possible. In this way, the proposed method will achieve better classification performance. To evaluate our method, we extensively conduct experiments both on synthetic data and real-world benchmarks in comparison with the existing DL-based classification algorithms, and the experimental results demonstrate the effectiveness of our method.
Multi-View Analysis Dictionary Learning for Image Classification.

Qianyu Wang,Yanqing Guo,Jiujun Wang,Xiangyang Luo,Xiangwei Kong

DOI: https://doi.org/10.1109/access.2018.2791578

IF: 3.9

2018-01-01

IEEE Access

Abstract:A great number of studies show that considering information from multiple views results in better performance than their single-view counterparts. However, many previous works aiming to improve classification performance fail to effectively tackle the inter-view correlation or the intra-class variability. Analysis dictionary learning (ADL) has theoretic significance and practical potential in classification tasks. Based on the ADL, this paper proposes a new method, namely, multi-view analysis dictionary learning (MvADL) for image classification. Specifically, multi-view analysis dictionaries are designed to reduce the intra-class variability in the transformed space in the multi-view scenario. Then, a marginalized classification term is incorporated to integrate the semantic information into the basic dictionary learning model. In the marginalized classification term, a marginalized target learning strategy is applied to improve the flexibility and discriminability of the whole model. Besides, an iteratively optimizing algorithm is designed to solve the proposed MvADL. Experiments on benchmark data sets demonstrate the superiority of our proposed method.
A Brief Summary of Dictionary Learning Based Approach for Classification (revised)

Shu Kong,Donghui Wang

2012-01-01

Abstract: This note presents some representative methods which are based on dictionary learning (DL) for classification. We do not review the sophisticated methods or frameworks that involve DL for classification, such as online DL and spatial pyramid matching (SPM), but rather, we concentrate on the direct DL-based classification methods. Here, the "so-called direct DL-based method" is the approach directly deals with DL framework by adding some meaningful penalty terms. By listing some representative methods, we can roughly divide them into two categories, i.e. (1) directly making the dictionary discriminative and (2) forcing the sparse coefficients discriminative to push the discrimination power of the dictionary. From this taxonomy, we can expect some extensions of them as future researches.
A dictionary learning approach for classification: separating the particularity and the commonality

Shu Kong,Donghui Wang

DOI: https://doi.org/10.1007/978-3-642-33718-5_14

2012-01-01

Abstract:Empirically, we find that, despite the class-specific features owned by the objects appearing in the images, the objects from different categories usually share some common patterns, which do not contribute to the discrimination of them. Concentrating on this observation and under the general dictionary learning (DL) framework, we propose a novel method to explicitly learn a common pattern pool (the commonality) and class-specific dictionaries (the particularity) for classification. We call our method DL-COPAR, which can learn the most compact and most discriminative class-specific dictionaries used for classification. The proposed DL-COPAR is extensively evaluated both on synthetic data and on benchmark image databases in comparison with existing DL-based classification methods. The experimental results demonstrate that DL-COPAR achieves very promising performances in various applications, such as face recognition, handwritten digit recognition, scene classification and object recognition.
Learning Exemplar-Represented Manifolds in Latent Space for Classification.

Shu Kong,Donghui Wang

DOI: https://doi.org/10.1007/978-3-642-40994-3_16

2013-01-01

Abstract:Intrinsic manifold structure of a data collection is valuable information for classification task. By considering the manifold structure in the data set for classification and with the sparse coding framework, we propose an algorithm to: (1) find exemplars from each class to represent the class-specific manifold structure, in which way the object-space dimensionality is reduced; (2) simultaneously learn a latent feature space to make the mapped data more discriminative according to the class-specific manifold measurement. We call the proposed algorithm Exemplar-represented Manifold in Latent Space for Classification (EMLSC). We also present the nonlinear extension of EMLSC based on kernel tricks to deal with highly nonlinear situations. Experiments on synthetic and real-world datasets demonstrate the merit of the proposed method.
A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

Xianjun Zhang,Min Yao,Rong Zhu

DOI: https://doi.org/10.1109/iasp.2010.5476120

2010-01-01

Abstract:Image classification is one of the important parts of digital image processing. We propose a novel feature space-based image classification method by combining manifold learning and mixture model. In this paper, the process of image classification can be viewed as two parts: a coarse-grained classification and a fine-grained classification. In the coarse-grained classification, we apply the ISOMAP (Isometric Mapping) algorithm to do a dimensional reduction based on manifold learning. Thus, solving the classification problem is transformed from a high-dimensional data space to a low-dimensional feature space. And then, during the fine-grained classification, we present an improved EM algorithm of finite Gaussian mixture model to do clustering. Experimental results have demonstrated that the proposed method performs well in both accuracy and time. Additionally, our algorithm is robust to some extent.
Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

Fang Li,Jia Sheng,San-yuan Zhang

DOI: https://doi.org/10.1631/fitee.1600039

IF: 2.526

2017-01-01

Frontiers of Information Technology & Electronic Engineering

Abstract:Sparse representation is a mathematical model for data representation that has proved to be a powerful tool for solving problems in various fields such as pattern recognition, machine learning, and computer vision. As one of the building blocks of the sparse representation method, dictionary learning plays an important role in the minimization of the reconstruction error between the original signal and its sparse representation in the space of the learned dictionary. Although using training samples directly as dictionary bases can achieve good performance, the main drawback of this method is that it may result in a very large and inefficient dictionary due to noisy training instances. To obtain a smaller and more representative dictionary, in this paper, we propose an approach called Laplacian sparse dictionary (LSD) learning. Our method is based on manifold learning and double sparsity. We incorporate the Laplacian weighted graph in the sparse representation model and impose the l1-norm sparsity on the dictionary. An LSD is a sparse overcomplete dictionary that can preserve the intrinsic structure of the data and learn a smaller dictionary for each class. The learned LSD can be easily integrated into a classification framework based on sparse representation. We compare the proposed method with other methods using three benchmark-controlled face image databases, Extended Yale B, ORL, and AR, and one uncontrolled person image dataset, i-LIDS-MA. Results show the advantages of the proposed LSD algorithm over state-of-the-art sparse representation based classification methods.
Discriminant sparse coding for image classification

Bao-Di Liu,Yu-Xiong Wang,Yu-Jin Zhang,Yin Zheng

DOI: https://doi.org/10.1109/ICASSP.2012.6288348

2012-01-01

ICASSP

Abstract:Recently, dictionary learned by sparse coding has been widely adopted in image classification and has achieved competitive performance. Sparse coding is capable of reducing the reconstruction error in transforming low-level descriptors into compact mid-level features. Nevertheless, dictionary learned by sparse coding does not have the ability to distinguish different classes. That is to say, it is not the optimum dictionary for the classification task. In this paper, based on the global image statistics, a novel discriminant dictionary learning method combining linear discriminant analysis with sparse coding is proposed to obtain a more discriminative dictionary while preserving its descriptive abilities and a block coordinate descent algorithm is proposed to solve the optimization problem. Experimental results show that our algorithm has capabilities to learn dictionary with more discriminative power and achieves superior performance.
Dictionary Learning and Sparse Coding on Grassmann Manifolds: an Extrinsic Solution

Mehrtash Harandi,Conrad Sanderson,Chunhua Shen,Brian C. Lovell

DOI: https://doi.org/10.1109/iccv.2013.387

2013-01-01

Abstract:Recent advances in computer vision and machine learning suggest that a wide range of problems can be addressed more appropriately by considering non-Euclidean geometry. In this paper we explore sparse dictionary learning over the space of linear subspaces, which form Riemannian structures known as Grassmann manifolds. To this end, we propose to embed Grassmann manifolds into the space of symmetric matrices by an isometric mapping, which enables us to devise a closed-form solution for updating a Grassmann dictionary, atom by atom. Furthermore, to handle non-linearity in data, we propose a kernelised version of the dictionary learning algorithm. Experiments on several classification tasks (face recognition, action recognition, dynamic texture classification) show that the proposed approach achieves considerable improvements in discrimination accuracy, in comparison to state-of-the-art methods such as kernelised Affine Hull Method and graphembedding Grassmann discriminant analysis.
Learning Discriminative Dictionary for Group Sparse Representation.

Yubao Sun,Qingshan Liu,Jinhui Tang,Dacheng Tao

DOI: https://doi.org/10.1109/tip.2014.2331760

IF: 10.6

2014-01-01

IEEE Transactions on Image Processing

Abstract:In recent years, sparse representation has been widely used in object recognition applications. How to learn the dictionary is a key issue to sparse representation. A popular method is to use l1 norm as the sparsity measurement of representation coefficients for dictionary learning. However, the l1 norm treats each atom in the dictionary independently, so the learned dictionary cannot well capture the multisubspaces structural information of the data. In addition, the learned subdictionary for each class usually shares some common atoms, which weakens the discriminative ability of the reconstruction error of each subdictionary. This paper presents a new dictionary learning model to improve sparse representation for image classification, which targets at learning a class-specific subdictionary for each class and a common subdictionary shared by all classes. The model is composed of a discriminative fidelity, a weighted group sparse constraint, and a subdictionary incoherence term. The discriminative fidelity encourages each class-specific subdictionary to sparsely represent the samples in the corresponding class. The weighted group sparse constraint term aims at capturing the structural information of the data. The subdictionary incoherence term is to make all subdictionaries independent as much as possible. Because the common subdictionary represents features shared by all classes, we only use the reconstruction error of each class-specific subdictionary for classification. Extensive experiments are conducted on several public image databases, and the experimental results demonstrate the power of the proposed method, compared with the state-of-the-arts.
Support Discrimination Dictionary Learning For Image Classification

Yang Liu,Wei Chen,Qingchao Chen,Ian J. Wassell

DOI: https://doi.org/10.1007/978-3-319-46475-6_24

2016-01-01

Abstract:Dictionary learning has been successfully applied in image classification. However, many dictionary learning methods that encode only a single image at a time while training, ignore correlation and other useful information contained within the entire training set. In this paper, we propose a new principle that uses the support of the coefficients to measure the similarity between the pairs of coefficients, instead of using Euclidian distance directly. More specifically, we proposed a support discrimination dictionary learning method, which finds a dictionary under which the coefficients of images from the same class have a common sparse structure while the size of the overlapped signal support of different classes is minimised. In addition, adopting a shared dictionary in a multi-task learning setting, this method can find the number and position of associated dictionary atoms for each class automatically by using structured sparsity on a group of images. The proposed model is extensively evaluated using various image datasets, and it shows superior performance to many state-of-the-art dictionary learning methods.
Information-theoretic Dictionary Learning for Image Classification

Qiang Qiu,Vishal M. Patel,Rama Chellappa

DOI: https://doi.org/10.48550/arXiv.1208.3687

2012-08-18

Abstract:We present a two-stage approach for learning dictionaries for object classification tasks based on the principle of information maximization. The proposed method seeks a dictionary that is compact, discriminative, and generative. In the first stage, dictionary atoms are selected from an initial dictionary by maximizing the mutual information measure on dictionary compactness, discrimination and reconstruction. In the second stage, the selected dictionary atoms are updated for improved reconstructive and discriminative power using a simple gradient ascent algorithm on mutual information. Experiments using real datasets demonstrate the effectiveness of our approach for image classification tasks.

Computer Vision and Pattern Recognition,Information Theory,Machine Learning
Image Classification with Tailored Fine-Grained Dictionaries

Xiangbo Shu,Jinhui Tang,Guo-Jun Qi,Zechao Li,Yu-Gang Jiang,Shuicheng Yan

DOI: https://doi.org/10.1109/tcsvt.2016.2607345

IF: 5.859

2018-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:In this paper, we propose a novel fine-grained dictionary learning method for image classification. To learn a high-quality discriminative dictionary, three types of multispecific subdictionaries, i.e., class-specific dictionaries (CSDs), universal dictionary (UD), and family-specific dictionaries (FSDs), are simultaneously uncovered. Here, CSDs and UD, respectively, model the patterns for each class and the patterns irrespective of any class. FSDs can help reveal the shared patterns between multiple image classes, by filling the gap between the patterns in CSDs and UD. The dependence among image classes is revealed by the shared FSDs, and a common FSD can be assigned to several classes to represent their residual. Finally, the most discriminative FSD for each class is identified by minimizing the sparse reconstruction error. Extensive experiments are conducted on different widely used data sets for image classification. The results demonstrate the superior performance of the proposed method over some state-of-the-art methods.
Learning attribute-aware dictionary for image classification and search

Junjie Cai,Zheng-Jun Zha,Huanbo Luan,Shiliang Zhang,Qi Tian

DOI: https://doi.org/10.1145/2461466.2461473

2013-01-01

Abstract:Bag-of-visual words (BoW) model has recently been well advocated for image classification and search. However, one critical limitation of existing BoW model is the lack of semantic information. To alleviate the impact of this issue, it is imperative to construct semantic-aware visual dictionary. In this paper, we propose a novel approach for learning visual word dictionary embedding intermediate-level semantics. Specifically, we first introduce an Attribute aware Dictionary Learning(AttrDL) scheme to learn multiple sub-dictionaries with specific semantic meanings. We divide training images into different sets and each represents a specific attribute. For each image set, an attribute-aware sub-vocabulary is learned. Hence, these resulting sub-vocabularies are more discriminative for semantics than the traditional vocabularies. Second, to get semantic-aware and discriminative BoW representation with the learned sub-vocabularies, we adopt the idea of L21-norm regularized sparse coding and recode the resulting sparse representation of each image. Experimental results show that the proposed scheme outperforms the state-of-the-art algorithms in both image classification and search tasks.
Multi-level Discriminative Dictionary Learning with Application to Large Scale Image Classification.

Li Shen,Gang Sun,Qingming Huang,Shuhui Wang,Zhouchen Lin,Enhua Wu

DOI: https://doi.org/10.1109/tip.2015.2438548

IF: 10.6

2015-01-01

IEEE Transactions on Image Processing

Abstract:The sparse coding technique has shown flexibility and capability in image representation and analysis. It is a powerful tool in many visual applications. Some recent work has shown that incorporating the properties of task (such as discrimination for classification task) into dictionary learning is effective for improving the accuracy. However, the traditional supervised dictionary learning methods suffer from high computation complexity when dealing with large number of categories, making them less satisfactory in large scale applications. In this paper, we propose a novel multi-level discriminative dictionary learning method and apply it to large scale image classification. Our method takes advantage of hierarchical category correlation to encode multi-level discriminative information. Each internal node of the category hierarchy is associated with a discriminative dictionary and a classification model. The dictionaries at different layers are learnt to capture the information of different scales. Moreover, each node at lower layers also inherits the dictionary of its parent, so that the categories at lower layers can be described with multi-scale information. The learning of dictionaries and associated classification models is jointly conducted by minimizing an overall tree loss. The experimental results on challenging data sets demonstrate that our approach achieves excellent accuracy and competitive computation cost compared with other sparse coding methods for large scale image classification.
Visual feature coding for image classification integrating dictionary structure

YangYu-Bin,ZhuQi-Hai,MaoXiao-Jiao,PanLin-Yan

IF: 8

2015-01-01

Pattern Recognition

Abstract:Methods based on the Bag-Of-Words (BoW) model have made a remarkable success in image classification, but many of which do not consider the structure underlying in the dictionary itself in the feat...
An Image Classification Method Based on Multiple Visual Dictionaries

Jian Zhang,Xiao-yin Zhang,Zhou Lei,Wen-feng Shen

DOI: https://doi.org/10.1109/csa.2015.18

2015-01-01

Abstract:In recent years, the bag of visual words (BoV) model is very popular in the field of computer vision. In particular, it has been widely used for image classification. The earliest method based on the BoV model, when constructing the visual dictionary, uses the clustering method to generate a single visual dictionary. This method does not consider the differences between categories of image dataset, leading to a poor performance of image classification. Later, an improved method is proposed that builds a visual dictionary for each category in the image dataset and then concatenates the visual dictionaries to produce the final visual dictionary. However, when there are many categories in the image dataset, using this method is time consuming. In addition, building a visual dictionary for each category leads to the visual words being too dense, losing the ability of distinguishing and expressing information and decreasing the performance of the image classification. In this paper, we proposed a new image classification method that is based on multiple visual dictionaries. This method addresses the above problems effectively and improves the performance of image classification significantly. To build a visual dictionary, the proposed image classification method first divides the image dataset containing many categories into N items randomly and uses the clustering method to cluster the local features of images of N items respectively. Next it generates a visual dictionary for each item in the image dataset. Finally it connects the visual dictionaries to produce the final visual dictionary of the entire image dataset. We conducted experiments on the caltech-101 and scene-67 image libraries and compared to the traditional methods. Our experimental results show that our proposed image classification method can match the best results published in the previous literatures in terms of classification accuracy rate.

Learning dictionary on manifolds for image classification

Learning Dictionary on Manifolds for Image Classification

Dictionary Learning on Multiple Manifolds for Image Classification

Online Discriminative Dictionary Learning for Image Classification Based on Block-Coordinate Descent Method

A Classification-Oriented Dictionary Learning Model: Explicitly Learning the Particularity and Commonality Across Categories.

Multi-View Analysis Dictionary Learning for Image Classification.

A Brief Summary of Dictionary Learning Based Approach for Classification (revised)

A dictionary learning approach for classification: separating the particularity and the commonality

Learning Exemplar-Represented Manifolds in Latent Space for Classification.

A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

Discriminant sparse coding for image classification

Dictionary Learning and Sparse Coding on Grassmann Manifolds: an Extrinsic Solution

Learning Discriminative Dictionary for Group Sparse Representation.

Support Discrimination Dictionary Learning For Image Classification

Information-theoretic Dictionary Learning for Image Classification

Image Classification with Tailored Fine-Grained Dictionaries

Learning attribute-aware dictionary for image classification and search

Multi-level Discriminative Dictionary Learning with Application to Large Scale Image Classification.

Visual feature coding for image classification integrating dictionary structure

An Image Classification Method Based on Multiple Visual Dictionaries