Abstract:Bag-of-visual Words (BoW) image representation has been illustrated as one of the most promising solutions for large-scale near-duplicated image retrieval. However, the traditional visual vocabulary is created in an unsupervised way by clustering a large number of image local features. This is not ideal because it largely ignores the semantic and spatial contexts between local features. In this paper, we propose the geometric visual vocabulary which captures the spatial contexts by quantizing local features in bi-space, i.e., in descriptor space and orientation space. Then, we propose to capture the semantic context by learning a semantic-aware distance metric between local features, which could reasonably measure the semantic similarities between image patches, from which the local features are extracted. The learned distance is hence utilized to cluster the local features for semantic visual vocabulary generation. Finally, we combine the spatial and semantic contexts in a unified framework by extracting local feature groups, computing the spatial configurations between the local features inside the group, and learning a semantic-aware distance between groups. The learned group distance is then utilized to cluster the extracted local feature groups to generate a novel visual vocabulary, i.e., the contextual visual vocabulary. The proposed visual vocabularies, i.e., geometric visual vocabulary, semantic visual vocabulary and contextual visual vocabulary are tested in large-scale near-duplicated image retrieval applications. The geometric visual vocabulary and semantic visual vocabulary achieve better performance than the traditional visual vocabulary. Moreover, the contextual visual vocabulary, which combines both spatial and semantic clues outperforms the state-of-the-art bundled feature in both retrieval precision and efficiency.

Semantic-oriented 3D Model Retrieval Using Visual Vocabulary Labelling

Semantic-oriented 3D model classification and retrieval using Gaussian processes

An Overview of Semantics Processing in Content-Based 3D Model Retrieval

An Ontology-Based Semantic Retrieval Approach for Heterogeneous 3D CAD Models

Learning A Semantic Space from User'S Relevance Feedback for Image Retrieval

Domain-Specific Modeling and Semantic Alignment for Image-Based 3d Model Retrieval

3D Model Retrieval with Multi-Granular Semantics Based on Gaussian Process Classifier

Probabilistic Latent Semantic Analysis for Sketch-Based 3D Model Retrieval

Feature Representation for 3D Object Retrieval Based on Unconstrained Multi-View

3D model semantic classification and retrieval with Gaussian processes

Sketch-Based 3D Model Retrieval via Multi-feature Fusion

Fast Object Retrieval Using Direct Spatial Matching

Using Visual Dictionary to Associate Semantic Objects in Region-Based Image Retrieval

Modeling spatial and semantic cues for large-scale near-duplicated image retrieval

Towards Semantic Embedding In Visual Vocabulary

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

A New Sketch-Based 3D Model Retrieval Approach by Using Global and Local Features

Image Retrieval Model Providing Semantics and Visual-Features-based Query for Users

3D Models Semantic Retrieval Method in Combination with Descriptive Text

Mapping Features to Semantic Space for 3D Model Retrieval

3D Model Retrieval from Multiple Photographic Images