Abstract:The Bag-of-Features (BoF) model has played an important role for image representation in many multimedia applications. It has been extensively applied to many tasks including image classification, image retrieval, scene understanding, and so on. Despite the advantages of this model such as simplicity, efficiency and generality, there are also notable drawbacks for this model, including poor power of semantic expression of local descriptors, and lack of robust structures upon single visual words. To overcome these problems, various techniques have been proposed, such as multiple descriptors, spatial context modeling and interest region detection. Though they have been proven to improve the BoF model to some extent, there still lacks a coherent scheme to integrate each individual module. To address the problems above, we propose a novel framework with spatial pooling of heterogeneous features. Our framework differs from the traditional Bag-of-Features model on three aspects. First, we propose a new scheme for combining texture and edge based local features together at the descriptor extraction level. Next, we build geometric visual phrases to model spatial context upon heterogeneous features for mid-level representation of images. Finally, based on a smoothed edgemap, a simple and effective spatial weighting scheme is performed on our mid-level image representation. We test our integrated framework on several benchmark datasets for image classification and retrieval applications. The extensive results show the superior performance of our algorithm over state-of-the-art methods.

Hierarchical feature coding for image classification

Image Classification Method by Combining Multi-features and Sparse Coding

Image Feature Extraction Method Based On Sparse Coding Framework Of Hypergraph

Hierarchical Bag-Of-Features For Hand Posture Recognition

Shrinking Encoding with Two-Level Codebook Learning for Fine-Grained Fish Recognition

Linear Distance Coding for Image Classification

Spatial Locality-Preserving Feature Coding for Image Classification

Research on Image Classification Method of Features of Combinatorial Convolution

Weakly supervised sparse coding with geometric consistency pooling

Image Classification by Hierarchical Spatial Pooling with Partial Least Squares Analysis.

Visual Feature Coding for Image Classification Integrating Dictionary Structure

Image Classification Based on Weight Adjustment before Feature Pooling.

Simple Techniques Make Sense: Feature Pooling and Normalization for Image Classification

Adjacent Coding for Image Classification.

Learning Relative Features Through Adaptive Pooling for Image Classification

Considering The Spatial Layout Information Of Bag Of Features (Bof) Framework For Image Classification

Local Hybrid Coding for Image Classification

Two-level Hierarchical Feature Learning for Image Classification

Spatial pooling of heterogeneous features for image applications.

WaveLBP based hierarchical features for image classification

Spatial pooling of heterogeneous features for image classification.