Abstract:Unsupervised hashing has the desirable advantages of label independence, high storage, and retrieval efficiency, which is suitable for scalable image retrieval. Most existing methods focus on enhancing the image hashing model training process at the offline stage. However, little attention has been paid to the query content analysis by them at the online retrieval stage. They still suffer from important query semantic shortages, and thus limit the online retrieval performance, which is the ultimate objective of the image retrieval system. In this paper, we propose an Online Query Expansion Hashing (OQEH) for efficient image retrieval, by adaptively enhancing the discriminative capability of query hash codes in an expansion manner at the online retrieval stage. Specifically, we first design a self-expansion network to learn semantically invariant feature representations from images and their visual augmentations. Then, we conduct neighborhood-expansion to search similar samples for each image from a query expansion set with the semantically invariant features and design a Transformer architecture to adaptively transfer the semantics of neighbor samples to their corresponding images. With the support of semantically invariant features, query expansion set, and adaptive semantic transfer, the representation capability of query hash codes can be enhanced at the online retrieval stage. Experimental results demonstrate that the proposed OQEH method achieves superior retrieval accuracy and comparable retrieval efficiency compared with the state-of-the-art methods. Particularly, on MS COCO dataset, OQEH can obtain about 6% performance improvement compared with the state-of-the-art results. The source codes of our method are available at: https://github.com/christinecui/OQEH.

Consensus Knowledge Exploitation for Partial Query Based Image Retrieval

A Survey of Personalised Image Retrieval and Recommendation.

Multi-Query Parallel Field Ranking for image retrieval.

OCTOPUS: aggressive search of multi-modality data using multifaceted knowledge base.

A Novel Approach Supporting Multi-image Queries in Image Retrieval

Hypergraph-based multi-example ranking with sparse representation for transductive learning image retrieval

A Novel Retrieval Refinement and Interaction Pattern by Exploring Result Correlations for Image Retrieval

Online Query Expansion Hashing for Efficient Image Retrieval

Relevance Feedback: a Power Tool for Interactive Content-Based Image Retrieval

Improving Object Retrieval Quality by Integration of Similarity Propagation and Query Expansion

Flickr30K-CFQ: A Compact and Fragmented Query Dataset for Text-image Retrieval

From A Glance to "Gotcha": Interactive Facial Image Retrieval with Progressive Relevance Feedback

Attribute feedback

Image Retrieval Framework Driven by Association Feedback with Feature Elements Evaluation Built In

Relevance Feedback Techniques In Interactive Content-Based Image Retrieval

Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxy

A new image retrieval system supporting query by semantics and example

Conversational Image Search

Collaborative Group: Composed Image Retrieval via Consensus Learning from Noisy Annotations

Image Retrieval by User-oriented Ranking

New Query Refinement and Semantics Integrated Image Retrieval System with Semiautomatic Annotation Scheme.