Abstract:The state-of-the-art image classification models, generally including feature coding and pooling, have been widely adopted to generate discriminative and robust image representations. However, the coding schemes available in these models only preserve salient features which results in information loss in the process of generating final image representations. To address this issue, we propose a novel spatial locality-preserving feature coding strategy which selects representative codebook atoms based on their density distribution to retain the structure of features more completely and make representations more descriptive. In the codebook learning stage, we propose an effective approximated K-means with cluster closures to initialize the codebook and independently adjust the center of each cluster of the dense regions. Afterwards, in the coding stage, we first define the concept of “density” to describe the spatial relationship among the code atoms and the features. Then, the responses of local features are adaptively encoded. Finally, in the pooling stage, a locality-preserving pooling strategy is utilized to aggregate the encoded response vectors into a statistical vector for representing the whole image or all the regions of interest. We carry out image classification experiments on three commonly used benchmark datasets including 15-Scene, Caltech-101, and Caltech-256. The experimental results demonstrate that, comparing with the state-of-the-art Bag-of-Words (BoW) based methods, our approach achieves the best classification accuracy on these benchmarked datasets.

Image Classification Based on Saliency Coding with Category-Specific Codebooks

Image Classification Method by Combining Multi-features and Sparse Coding

Efficient Classification Using Salient Regions

Salient Coding for Image Classification

Group Encoding of Local Features in Image Classification

Saliency Aware Locality-preserving Coding for Image Classification

Adjacent Coding for Image Classification.

Spatial Locality-Preserving Feature Coding for Image Classification

Visual saliency coding for image categorization

Pixel Saliency Based Encoding for Fine-Grained Image Classification.

Feature selection based codebooks construction for scene categorization

Mutual information based codebooks construction for natural scene categorization

Feature coding in image classification: a comprehensive study.

Category Sensitive Codebook Construction for Object Category Recognition

Fine-Grained Image Classification Via Low-Rank Sparse Coding with General and Class-Specific Codebooks.

Discriminative Spatial Codebook Generation for Image Classification

Context-Aware and Locality-Constrained Coding for Image Categorization

Sparse code LBP and SIFT features together for scene categorization

Combining LBP and SIFT in Sparse Coding for Categorizing Scene Images.

Local Hybrid Coding for Image Classification

A Saliency-based Weakly-supervised Network for Fine-Grained Image Categorization