Abstract:Bag-of-visual Words (BoW) image representation has been illustrated as one of the most promising solutions for large-scale near-duplicated image retrieval. However, the traditional visual vocabulary is created in an unsupervised way by clustering a large number of image local features. This is not ideal because it largely ignores the semantic and spatial contexts between local features. In this paper, we propose the geometric visual vocabulary which captures the spatial contexts by quantizing local features in bi-space, i.e., in descriptor space and orientation space. Then, we propose to capture the semantic context by learning a semantic-aware distance metric between local features, which could reasonably measure the semantic similarities between image patches, from which the local features are extracted. The learned distance is hence utilized to cluster the local features for semantic visual vocabulary generation. Finally, we combine the spatial and semantic contexts in a unified framework by extracting local feature groups, computing the spatial configurations between the local features inside the group, and learning a semantic-aware distance between groups. The learned group distance is then utilized to cluster the extracted local feature groups to generate a novel visual vocabulary, i.e., the contextual visual vocabulary. The proposed visual vocabularies, i.e., geometric visual vocabulary, semantic visual vocabulary and contextual visual vocabulary are tested in large-scale near-duplicated image retrieval applications. The geometric visual vocabulary and semantic visual vocabulary achieve better performance than the traditional visual vocabulary. Moreover, the contextual visual vocabulary, which combines both spatial and semantic clues outperforms the state-of-the-art bundled feature in both retrieval precision and efficiency.

Complex spatial region representation and similar matching for multi-object image retrieval

Feature Representation for 3D Object Retrieval Based on Unconstrained Multi-View

Domain-Specific Modeling and Semantic Alignment for Image-Based 3d Model Retrieval

3D object retrieval by bipartite matching

An Object-Level Feature Representation Model for the Multi-target Retrieval of Remote Sensing Images.

Constraint Based Region Matching for Image Retrieval

Fast Object Retrieval Using Direct Spatial Matching

Object-Based Image Retrieval Using Spatial Context

Object retrieval using configurations of salient regions

A parameterized evaluation model of similarity on multi-target retrieval for remote sensing image

An image representation method based on the similarity of feature points

Spatial Relationship Representation for Visual Object Searching

Multi-View Object Retrieval Via Multi-Scale Topic Models.

Fast and Robust Spatial Matching for Object Retrieval

Image retrieval for Structure-from-Motion via Graph Convolutional Network

Region Similarity Arrangement for Large-Scale Image Retrieval

Embedding Multi-Order Spatial Clues for Scalable Visual Matching and Retrieval.

Scalable Object Retrieval with Compact Image Representation from Generic Object Regions

Combining Local Descriptions With Geometric Constraints For 3-D Object Recognition In Multiple Statuses

Modeling spatial and semantic cues for large-scale near-duplicated image retrieval

Multi-Level structured image coding on high-dimensional image representation