Abstract:The Bag-of-Words (BoW) framework is well-known in image classification. In the framework, there are two essential steps: 1) coding, which encodes local features by a visual vocabulary, and 2) pooling, which pools over the response of all features into image representation. Many coding and pooling methods are proposed, and how to apply them better in different conditions has become a practical problem. In this paper, to better use BoW in different applications, we study the relation between many typical coding methods and two popular pooling methods. Specifically, complete combinations of coding and pooling are evaluated based on an extremely large range of vocabulary sizes (16 to 1M) on five primary and popular datasets. Three typical ones are 15 Scenes, Caltech 101 and PASCAL VOC 2007, while the other two large-scale ones are Caltech 256 and ImageNet. Based on the systematic evaluation, some interesting conclusions are drawn. Some conclusions are the extensions of previous viewpoints, while some are different but important to understand BoW model. Based on these conclusions, we provide detailed application criterions by evaluating coding and pooling based on precision, efficiency and memory requirements in different applications. We hope that this study can be helpful to evaluate different coding and pooling methods, the conclusions can be beneficial to better understand BoW, and the application criterions can be valuable to use BoW better in different applications.

An image classification method based on bag of words model

Object Recognition Based on the Region of Interest and Optimal Bag of Words Model.

Image classification with Bag-of-Words model based on improved SIFT algorithm

Image Classification Based on Modified BOW Model

Efficient Method for Image Classification Based on Low-Scale Bag of Word Model

Modified Bag of Visual Words Model for Image Classification

An Image Classification Method Based on Optimized Fuzzy Bag-of-words Model

The Extended Bag of Words Model for Visual Recognition and Categorization

Nearest-Neighbors Based Weighted Method for the BOVW Applied to Image Classification

Improving Bag-of-words Scheme for Scene Categorization

Image Classification Based on SIFT and SVM.

A Novel Image Classification Algorithm Based on Word Bag Model and Feature Extraction

Image Classification by Exploiting the Spatial Context Information

Bag-of-Visual-Words Model Based on Classified Vector Quantization and Its Application in Image Classification

How to use Bag-of-Words model better for image classification

Understanding bag-of-words model: a statistical framework

Effective Image Representation Based on Bi-Layer Visual Codebook

Integrating ILSR to Bag-of-Visual Words Model Based on Sparse Codes of SIFT Features Representations

Object categorization based on a supervised mean shift algorithm

Bag-of-words image representation based on classified vector quantization

Visual Attention Based Bag-of-words Model for Image Classification