Abstract:Unsupervised hashing has the desirable advantages of label independence, high storage, and retrieval efficiency, which is suitable for scalable image retrieval. Most existing methods focus on enhancing the image hashing model training process at the offline stage. However, little attention has been paid to the query content analysis by them at the online retrieval stage. They still suffer from important query semantic shortages, and thus limit the online retrieval performance, which is the ultimate objective of the image retrieval system. In this paper, we propose an Online Query Expansion Hashing (OQEH) for efficient image retrieval, by adaptively enhancing the discriminative capability of query hash codes in an expansion manner at the online retrieval stage. Specifically, we first design a self-expansion network to learn semantically invariant feature representations from images and their visual augmentations. Then, we conduct neighborhood-expansion to search similar samples for each image from a query expansion set with the semantically invariant features and design a Transformer architecture to adaptively transfer the semantics of neighbor samples to their corresponding images. With the support of semantically invariant features, query expansion set, and adaptive semantic transfer, the representation capability of query hash codes can be enhanced at the online retrieval stage. Experimental results demonstrate that the proposed OQEH method achieves superior retrieval accuracy and comparable retrieval efficiency compared with the state-of-the-art methods. Particularly, on MS COCO dataset, OQEH can obtain about 6% performance improvement compared with the state-of-the-art results. The source codes of our method are available at: https://github.com/christinecui/OQEH.

HQE: A hybrid method for query expansion

Query expansion based on Web knowledge base and search engine

Concept based query expansion using hidden markov model

A neuro-fuzzy algorithm for query expansion and information retrieval

Improving Query Expansion Using WordNet

Concept Based Query and Document Expansion Using Hidden Markov Model

A Semantic Query Expansion-Based Patent Retrieval Approach

A new approach for query expansion using Wikipedia and WordNet

Event-Centric Query Expansion in Web Search

Concept Based Query Expansion Using Wordnet

Systematic Study on Query Expansion

An Approach to Semantic Query Expansion System Based on Hepatitis Ontology

A Hybrid Text Generation-Based Query Expansion Method for Open-Domain Question Answering

Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering.

Multi-modal query expansion for web video search

Online Query Expansion Hashing for Efficient Image Retrieval

How effective is query expansion for finding novel information?

Progressive Query Expansion for Retrieval Over Cost-constrained Data Sources

Query Expansion for Short Queries by Mining User Logs

Using WordNet in Conceptual Query Expansion

Query Expansion by Mining User Logs