Abstract:Bag-of-visual Words (BoW) image representation has been illustrated as one of the most promising solutions for large-scale near-duplicated image retrieval. However, the traditional visual vocabulary is created in an unsupervised way by clustering a large number of image local features. This is not ideal because it largely ignores the semantic and spatial contexts between local features. In this paper, we propose the geometric visual vocabulary which captures the spatial contexts by quantizing local features in bi-space, i.e., in descriptor space and orientation space. Then, we propose to capture the semantic context by learning a semantic-aware distance metric between local features, which could reasonably measure the semantic similarities between image patches, from which the local features are extracted. The learned distance is hence utilized to cluster the local features for semantic visual vocabulary generation. Finally, we combine the spatial and semantic contexts in a unified framework by extracting local feature groups, computing the spatial configurations between the local features inside the group, and learning a semantic-aware distance between groups. The learned group distance is then utilized to cluster the extracted local feature groups to generate a novel visual vocabulary, i.e., the contextual visual vocabulary. The proposed visual vocabularies, i.e., geometric visual vocabulary, semantic visual vocabulary and contextual visual vocabulary are tested in large-scale near-duplicated image retrieval applications. The geometric visual vocabulary and semantic visual vocabulary achieve better performance than the traditional visual vocabulary. Moreover, the contextual visual vocabulary, which combines both spatial and semantic clues outperforms the state-of-the-art bundled feature in both retrieval precision and efficiency.

Distance-based Multiple Paths Quantization of Vocabulary Tree for Object and Scene Retrieval

Indexing Large Visual Vocabulary by Randomized Dimensions Hashing for High Quantization Accuracy: Improving the Object Retrieval Quality

Vocabulary Hierarchy Optimization for Effective and Transferable Retrieval

A Multi-Sample, Multi-Tree Approach to Bag-of-words Image Representation for Image Retrieval

Fast Object Retrieval Using Direct Spatial Matching

Pruning Tree-Structured Vector Quantizer Towards Low Bit Rate Mobile Visual Search

Large scale partial-duplicate image retrieval with bi-space quantization and geometric consistency

Efficient multi-nodes image retrieval method based on visual words

Large-Scale Image Retrieval Method Based On Vocabulary Tree

The Indexing Based on Multiple Visual Dictionaries for Object Based Image Retrieval.

Image retrieval algorithm based on improved visual dictionary model

Learning to Hash with Dimension Analysis Based Quantizer for Image Retrieval

Fast Visual Word Quantization Via Spatial Neighborhood Boosting

Large-scale Image Retrieval Based on the Vocabulary Tree

Hierarchical Multi-Vlad For Image Retrieval

Image Search Based on Vocabulary Tree

Scalar Quantization for Large Scale Image Search

Boosting 3d Model Retrieval with Class Vocabularies and Distance Vector Revision

Image retrieval by information fusion based on scalable vocabulary tree and robust Hausdorff distance

Modeling spatial and semantic cues for large-scale near-duplicated image retrieval

RETRACTED ARTICLE: The model for improving big data sub-image retrieval performance using scalable vocabulary tree based on predictive clustering