Abstract:Bag-of-visual Words (BoW) image representation has been illustrated as one of the most promising solutions for large-scale near-duplicated image retrieval. However, the traditional visual vocabulary is created in an unsupervised way by clustering a large number of image local features. This is not ideal because it largely ignores the semantic and spatial contexts between local features. In this paper, we propose the geometric visual vocabulary which captures the spatial contexts by quantizing local features in bi-space, i.e., in descriptor space and orientation space. Then, we propose to capture the semantic context by learning a semantic-aware distance metric between local features, which could reasonably measure the semantic similarities between image patches, from which the local features are extracted. The learned distance is hence utilized to cluster the local features for semantic visual vocabulary generation. Finally, we combine the spatial and semantic contexts in a unified framework by extracting local feature groups, computing the spatial configurations between the local features inside the group, and learning a semantic-aware distance between groups. The learned group distance is then utilized to cluster the extracted local feature groups to generate a novel visual vocabulary, i.e., the contextual visual vocabulary. The proposed visual vocabularies, i.e., geometric visual vocabulary, semantic visual vocabulary and contextual visual vocabulary are tested in large-scale near-duplicated image retrieval applications. The geometric visual vocabulary and semantic visual vocabulary achieve better performance than the traditional visual vocabulary. Moreover, the contextual visual vocabulary, which combines both spatial and semantic clues outperforms the state-of-the-art bundled feature in both retrieval precision and efficiency.

A Combination of Bag of Categorized Visual Words and Tag Voting Based Image Retrieval

A Graph Community and Bag of Categorized Visual Words Based Image Retrieval.

Bag of Spatial Visual Words Model for Scene Classification

Modeling spatial and semantic cues for large-scale near-duplicated image retrieval

The Extended Bag of Words Model for Visual Recognition and Categorization

Indexing Large Visual Vocabulary by Randomized Dimensions Hashing for High Quantization Accuracy: Improving the Object Retrieval Quality

A Generalized BoVW Model for Content-Based Image Retrieval

A Novel Image Retrieval Approach With Bag-Of-Word Model And Gabor Feature

Bag-of-words image representation based on classified vector quantization

Latent Dirichlet Allocation Based Image Retrieval

Combined Category Visual Vocabulary: A new approach to visual vocabulary construction

Creating the Bag-of-Words with Spatial Context Information for Image Retrieval

Rebuilding Visual Vocabulary via Spatial-temporal Context Similarity for Video Retrieval

Weighting Scheme for Image Retrieval Based on Bag-of-visual-words.

A New Bag-of-words Model Using Multi-Cue Integration for Image Retrieval

Bag-of-Visual Words based Improved Image Retrieval Algorithm for Vision Indoor Positioning.

OBJECT RETRIVAL BASED ON VISUAL WORD PAIRS

Evaluating Bag-of-visual-words Representations in Scene Classification

Region Contextual Visual Words for scene categorization

Bag-of-Visual-Words Model Based on Classified Vector Quantization and Its Application in Image Classification

Visual Words Refining Exploiting Spatial Co-Occurrence Table