Abstract:We investigate bag-of-visual-words (BOVW) approaches to land-use classification in high-resolution overhead imagery. We consider a standard non-spatial representation in which the frequencies but not the locations of quantized image features are used to discriminate between classes analogous to how words are used for text document classification without regard to their order of occurrence. We also consider two spatial extensions, the established spatial pyramid match kernel which considers the absolute spatial arrangement of the image features, as well as a novel method which we term the spatial co-occurrence kernel that considers the relative arrangement. These extensions are motivated by the importance of spatial structure in geographic data. The methods are evaluated using a large ground truth image dataset of 21 land-use classes. In addition to comparisons with standard approaches, we perform extensive evaluation of different configurations such as the size of the visual dictionaries used to derive the BOVW representations and the scale at which the spatial relationships are considered. We show that even though BOVW approaches do not necessarily perform better than the best standard approaches overall, they represent a robust alternative that is more effective for certain land-use classes. We also show that extending the BOVW approach with our proposed spatial co-occurrence kernel consistently improves performance.

Nearest-Neighbors Based Weighted Method for the BOVW Applied to Image Classification

Object Recognition Based on the Region of Interest and Optimal Bag of Words Model.

An image classification method based on bag of words model

Modified Bag of Visual Words Model for Image Classification

Effective Image Representation Based on Bi-Layer Visual Codebook

Spatially Constrained Bag-of-Visual-Words for Hyperspectral Image Classification

Visual Attention Based Bag-of-words Model for Image Classification

Image Classification Based on Nearest Neighbor Basis Vectors

The Extended Bag of Words Model for Visual Recognition and Categorization

Weighting informativeness of bag-of-visual-words by kernel optimization for video concept detection

Image classification with Bag-of-Words model based on improved SIFT algorithm

Image Classification Based on Modified BOW Model

Bag-of-Visual-Words Model Based on Classified Vector Quantization and Its Application in Image Classification

Robust Feature Encoding with Neighborhood Information for Image Classification

Bag-of-visual-words and Spatial Extensions for Land-Use Classification

Combining bag of visual words-based features with CNN in image classification

Image Classification Using Spatial Pyramid Coding And Visual Word Reweighting

Spatial Encoding of Visual Words for Image Classification.

Multi-layer orthogonal visual codebook for image classification

Exploring Local Features and the Bag-of-Visual-Words Approach for Bioimage Classification.

Object Classification of Aerial Images with Bag-of-Visual Words