Abstract:Bag-of-visual Words (BoW) image representation has been illustrated as one of the most promising solutions for large-scale near-duplicated image retrieval. However, the traditional visual vocabulary is created in an unsupervised way by clustering a large number of image local features. This is not ideal because it largely ignores the semantic and spatial contexts between local features. In this paper, we propose the geometric visual vocabulary which captures the spatial contexts by quantizing local features in bi-space, i.e., in descriptor space and orientation space. Then, we propose to capture the semantic context by learning a semantic-aware distance metric between local features, which could reasonably measure the semantic similarities between image patches, from which the local features are extracted. The learned distance is hence utilized to cluster the local features for semantic visual vocabulary generation. Finally, we combine the spatial and semantic contexts in a unified framework by extracting local feature groups, computing the spatial configurations between the local features inside the group, and learning a semantic-aware distance between groups. The learned group distance is then utilized to cluster the extracted local feature groups to generate a novel visual vocabulary, i.e., the contextual visual vocabulary. The proposed visual vocabularies, i.e., geometric visual vocabulary, semantic visual vocabulary and contextual visual vocabulary are tested in large-scale near-duplicated image retrieval applications. The geometric visual vocabulary and semantic visual vocabulary achieve better performance than the traditional visual vocabulary. Moreover, the contextual visual vocabulary, which combines both spatial and semantic clues outperforms the state-of-the-art bundled feature in both retrieval precision and efficiency.

Distributed Visual Retrieval Model Based on Potential Theme

Document Clustering Based on Probabilistic Topic Model

A LDA Topic Model Based Collection Selection Method for Distributed Information Retrieval

An Image Retrieval System with Color Emotion Query

Allocating images and selecting image collections for distributed visual search

Automatic Visual Theme Discovery from Joint Image and Text Corpora

MPVR: a multi-perspective visual retrieval toolkit for multi-dimensional data.

A Graph Community and Bag of Categorized Visual Words Based Image Retrieval.

M.Chord Based Distributed Interactive Visual Surveillance Retrieval Algorithm

Learning to Distribute Vocabulary Indexing for Scalable Visual Search

Topic Modeling Using Distributed Word Embeddings

Efficient Indexing for Large Scale Visual Search

Distributed Architecture for Large Scale Image-Based Search

Modeling spatial and semantic cues for large-scale near-duplicated image retrieval

A Combination of Bag of Categorized Visual Words and Tag Voting Based Image Retrieval

Multi-View Object Retrieval Via Multi-Scale Topic Models.

Image Retrieval Model Providing Semantics and Visual-Features-based Query for Users

Embedding Multi-Order Spatial Clues for Scalable Visual Matching and Retrieval.

A Novel Image Retrieval Approach Combining Multiple Features Of Color-Connected Regions

Multimedia Content-Based Visual Retrieval

A Transformer and Visual Foundation Model-Based Method for Cross-View Remote Sensing Image Retrieval