Abstract:Semantic gap, which refers to the limitation that low-level hand-crafted visual features insufficiently encode high-level semantic concepts contained in the images, has been a challenging issue in image retrieval and significantly impairs the performance of real-world retrieval systems. Despite massive efforts that have been devoted to developing effective image signatures, e.g., Bag-of-Visual-Words (BOVW), the Fisher Vector (FV) and the Vector of Locally Aggregated Descriptors (VLAD), these mid-level image features still fail to handle the problem of semantic gap and thus lead to suboptimal results. Towards this end, a large body of work focuses on introducing attribute learning into a variety of vision applications. As inherent nature that describes the intrinsic properties of objects, such as color, shape and rigidity, learned attributes serve as intermediate representations that bridge the semantic gap. However, conventional attribute embedding methods are generally developed for image global representation while ignoring local spatial cues, which prevents them from achieving desirable performance. In this paper, we attempt to encode weak spatial information into attribute embedding for effective image retrieval. Specifically, we partition the image into regular grids and extract Classemes attribute vector from each patch, which results in a large pool of Classemes descriptors followed by VLAD aggregation for generating holistic representation. In order to produce a compact and discriminative code, we employ a piecewise Fisher Discriminant Analysis (FDA) for dimension reduction and concatenate all the compressed Classemes into a single vector coined Spatially Pooled Attributes (SPA). Thorough experimental evaluation and comparative study on three public benchmarks demonstrate the superiority of the proposed approach.

Weak Attributes for Large-Scale Image Retrieval

Grouped Attribute Strength-Based Image Retrieval.

Model Semantic Relations with Extended Attributes

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

Image Retrieval by Extended Attribute Based on Web Search Amount

Experiments of Image Retrieval Using Weak Attributes

Attribute-Aware Deep Hashing with Self-Consistency for Large-Scale Fine-Grained Image Retrieval

Image ranking via attribute boosted hypergraph

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

SPA: Spatially Pooled Attributes for Image Retrieval.

Image Retrieval And Ranking Via Consistently Reconstructing Multi-Attribute Queries

Scalable Face Image Retrieval Using Attribute-Enhanced Sparse Codewords

Attribute hashing for zero-shot image retrieval

Augmented Image Retrieval Using Multi-Order Object Layout With Attributes

Attributes Grouping and Mining Hashing for Fine-Grained Image Retrieval

Image Retrieval with Attribute-Associated Auxiliary References

Fine-grained Sketch-Based Image Retrieval: the Role of Part-Aware Attributes

Very Large-Scale Image Retrieval Based on Local Features.

Deep Attribute-preserving Metric Learning for Natural Language Object Retrieval

Learning Weak Semantics by Feature Graph for Attribute-Based Person Search