Abstract:The Bag-of-Features (BoF) model has played an important role for image representation in many multimedia applications. It has been extensively applied to many tasks including image classification, image retrieval, scene understanding, and so on. Despite the advantages of this model such as simplicity, efficiency and generality, there are also notable drawbacks for this model, including poor power of semantic expression of local descriptors, and lack of robust structures upon single visual words. To overcome these problems, various techniques have been proposed, such as multiple descriptors, spatial context modeling and interest region detection. Though they have been proven to improve the BoF model to some extent, there still lacks a coherent scheme to integrate each individual module. To address the problems above, we propose a novel framework with spatial pooling of heterogeneous features. Our framework differs from the traditional Bag-of-Features model on three aspects. First, we propose a new scheme for combining texture and edge based local features together at the descriptor extraction level. Next, we build geometric visual phrases to model spatial context upon heterogeneous features for mid-level representation of images. Finally, based on a smoothed edgemap, a simple and effective spatial weighting scheme is performed on our mid-level image representation. We test our integrated framework on several benchmark datasets for image classification and retrieval applications. The extensive results show the superior performance of our algorithm over state-of-the-art methods.

Image Classification by Hierarchical Spatial Pooling with Partial Least Squares Analysis.

Image Classification Method by Combining Multi-features and Sparse Coding

Learning Class-Specific Pooling Shapes for Image Classification.

Generalized regular spatial pooling for image classification

Object-Centred Image Representation Based on Spatial Pyramid

Fast Low Rank Representation Based Spatial Pyramid Matching for Image Classification.

Image Classification Method Rationally Utilizing Spatial Information of the Image

Spatial Locality-Preserving Feature Coding for Image Classification

CSPS: An Adaptive Pooling Method for Image Classification

Combining Local and Global: Rich and Robust Feature Pooling for Visual Recognition.

Considering The Spatial Layout Information Of Bag Of Features (Bof) Framework For Image Classification

Spatial pooling of heterogeneous features for image applications.

Face Image Classification by Pooling Raw Features

Learning Relative Features Through Adaptive Pooling for Image Classification

Wasserstein Pooling for Image Classification

Pyramid Sub-Region Sensitive Network for Object Detection.

Weakly supervised sparse coding with geometric consistency pooling

BoW Pooling: A Plug-and-Play Unit for Feature Aggregation of Point Clouds

Simple Techniques Make Sense: Feature Pooling and Normalization for Image Classification

SSHPool: The Separated Subgraph-based Hierarchical Pooling

Face Identification with Second-Order Pooling