Abstract:The Bag-of-Features (BoF) model has played an important role for image representation in many multimedia applications. It has been extensively applied to many tasks including image classification, image retrieval, scene understanding, and so on. Despite the advantages of this model such as simplicity, efficiency and generality, there are also notable drawbacks for this model, including poor power of semantic expression of local descriptors, and lack of robust structures upon single visual words. To overcome these problems, various techniques have been proposed, such as multiple descriptors, spatial context modeling and interest region detection. Though they have been proven to improve the BoF model to some extent, there still lacks a coherent scheme to integrate each individual module. To address the problems above, we propose a novel framework with spatial pooling of heterogeneous features. Our framework differs from the traditional Bag-of-Features model on three aspects. First, we propose a new scheme for combining texture and edge based local features together at the descriptor extraction level. Next, we build geometric visual phrases to model spatial context upon heterogeneous features for mid-level representation of images. Finally, based on a smoothed edgemap, a simple and effective spatial weighting scheme is performed on our mid-level image representation. We test our integrated framework on several benchmark datasets for image classification and retrieval applications. The extensive results show the superior performance of our algorithm over state-of-the-art methods.

Spatial pooling of heterogeneous features for image classification.

Spatial pooling of heterogeneous features for image applications.

Generalized regular spatial pooling for image classification

Image Classification Method by Combining Multi-features and Sparse Coding

Considering The Spatial Layout Information Of Bag Of Features (Bof) Framework For Image Classification

Simple Techniques Make Sense: Feature Pooling and Normalization for Image Classification

Learning Relative Features Through Adaptive Pooling for Image Classification

Hierarchical Bag-Of-Features For Hand Posture Recognition

Image Classification Based on Weight Adjustment before Feature Pooling.

Spatial Locality-Preserving Feature Coding for Image Classification

Weakly supervised sparse coding with geometric consistency pooling

Spatial Pooling for Transformation Invariant Image Representation

BoW Pooling: A Plug-and-Play Unit for Feature Aggregation of Point Clouds

Learning Class-Specific Pooling Shapes for Image Classification.

Image Classification by Hierarchical Spatial Pooling with Partial Least Squares Analysis.

Spatial-Bag-Of-Features

Image Classification by Exploiting the Spatial Context Information

Towards Optimal Bag-of-features for Object Categorization and Semantic Video Retrieval

Bag of Shape Features with a Learned Pooling Function for Shape Recognition

Wasserstein Pooling for Image Classification

Combining Local and Global: Rich and Robust Feature Pooling for Visual Recognition.