Abstract:The state-of-the-art image classification models, generally including feature coding and pooling, have been widely adopted to generate discriminative and robust image representations. However, the coding schemes available in these models only preserve salient features which results in information loss in the process of generating final image representations. To address this issue, we propose a novel spatial locality-preserving feature coding strategy which selects representative codebook atoms based on their density distribution to retain the structure of features more completely and make representations more descriptive. In the codebook learning stage, we propose an effective approximated K-means with cluster closures to initialize the codebook and independently adjust the center of each cluster of the dense regions. Afterwards, in the coding stage, we first define the concept of “density” to describe the spatial relationship among the code atoms and the features. Then, the responses of local features are adaptively encoded. Finally, in the pooling stage, a locality-preserving pooling strategy is utilized to aggregate the encoded response vectors into a statistical vector for representing the whole image or all the regions of interest. We carry out image classification experiments on three commonly used benchmark datasets including 15-Scene, Caltech-101, and Caltech-256. The experimental results demonstrate that, comparing with the state-of-the-art Bag-of-Words (BoW) based methods, our approach achieves the best classification accuracy on these benchmarked datasets.

Spatial Context and Locality-constraint Based Linear Feature Coding

Image Classification Method by Combining Multi-features and Sparse Coding

Adjacent Coding for Image Classification.

Spatial Locality-Preserving Feature Coding for Image Classification

Context-Aware and Locality-Constrained Coding for Image Categorization

Locality-constrained Linear Coding for Image Classification.

Locality-constrained Affine Subspace Coding for Image Classification and Retrieval

Local Hybrid Coding for Image Classification

Scene Image Classification Using Locality-Constrained Linear Coding Based on Histogram Intersection

Spatially Constrained Sparse Coding Scheme for Natural Scene Categorization

From Dictionary of Visual Words to Subspaces: Locality-Constrained Affine Subspace Coding

Discriminative Sparse Neighbor Coding.

Spatial Neighborhood-Constrained Linear Coding for Visual Object Tracking

A Semantic Enhanced Linear Coding for Image Classification

Laplacian Regularized Locality-Constrained Coding for Image Classification.

Local hypersphere coding based on edges between visual words

A Two-Layer Local Constrained Sparse Coding Method for Fine-Grained Visual Categorization

Locality Sensitive Sparse Concept Coding and Its Application to Image Representation

Image classification using label constrained sparse coding

Spatially Regularized and Locality-Constrained Linear Coding for Human Action Recognition

Linear Distance Coding for Image Classification