Abstract:Bag-of-visual Words (BoW) image representation has been illustrated as one of the most promising solutions for large-scale near-duplicated image retrieval. However, the traditional visual vocabulary is created in an unsupervised way by clustering a large number of image local features. This is not ideal because it largely ignores the semantic and spatial contexts between local features. In this paper, we propose the geometric visual vocabulary which captures the spatial contexts by quantizing local features in bi-space, i.e., in descriptor space and orientation space. Then, we propose to capture the semantic context by learning a semantic-aware distance metric between local features, which could reasonably measure the semantic similarities between image patches, from which the local features are extracted. The learned distance is hence utilized to cluster the local features for semantic visual vocabulary generation. Finally, we combine the spatial and semantic contexts in a unified framework by extracting local feature groups, computing the spatial configurations between the local features inside the group, and learning a semantic-aware distance between groups. The learned group distance is then utilized to cluster the extracted local feature groups to generate a novel visual vocabulary, i.e., the contextual visual vocabulary. The proposed visual vocabularies, i.e., geometric visual vocabulary, semantic visual vocabulary and contextual visual vocabulary are tested in large-scale near-duplicated image retrieval applications. The geometric visual vocabulary and semantic visual vocabulary achieve better performance than the traditional visual vocabulary. Moreover, the contextual visual vocabulary, which combines both spatial and semantic clues outperforms the state-of-the-art bundled feature in both retrieval precision and efficiency.

Large-scale Vocabularies with Local Graph Diffusion and Mode Seeking

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Modeling spatial and semantic cues for large-scale near-duplicated image retrieval

Large Visual Words For Large Scale Image Classification

Multi-View Diffusion Process for Spectral Clustering and Image Retrieval

Very Large-Scale Image Retrieval Based on Local Features.

Improved Visual Vocabularies for Scene Classification of High Resolution Remote Sensing Imagery in Urban Areas

Learning to Distribute Vocabulary Indexing for Scalable Visual Search

Large Scale Nearest Neighbors Search Based on Neighborhood Graph.

Building Descriptive and Discriminative Visual Codebook for Large-Scale Image Applications.

Large-scale Multi-view Subspace Clustering in Linear Time

Randomized Locality Sensitive Vocabularies For Bag-Of-Features Model

Uniting Keypoints: Local Visual Information Fusion for Large-Scale Image Search

Democratic Diffusion Aggregation for Image Retrieval

Superpixels for Large Dataset Subspace Clustering.

Locality Preserving Multiview Graph Hashing for Large Scale Remote Sensing Image Search

Scalable one-stage multi-view subspace clustering with dictionary learning

Efficient Region-Aware Large Graph Construction Towards Scalable Multi-Label Propagation

Vocabulary Hierarchy Optimization for Effective and Transferable Retrieval

Image retrieval algorithm based on improved visual dictionary model

Large-Scale Video Retrieval Via Deep Local Convolutional Features.