Abstract:Unsupervised hashing has the desirable advantages of label independence, high storage, and retrieval efficiency, which is suitable for scalable image retrieval. Most existing methods focus on enhancing the image hashing model training process at the offline stage. However, little attention has been paid to the query content analysis by them at the online retrieval stage. They still suffer from important query semantic shortages, and thus limit the online retrieval performance, which is the ultimate objective of the image retrieval system. In this paper, we propose an Online Query Expansion Hashing (OQEH) for efficient image retrieval, by adaptively enhancing the discriminative capability of query hash codes in an expansion manner at the online retrieval stage. Specifically, we first design a self-expansion network to learn semantically invariant feature representations from images and their visual augmentations. Then, we conduct neighborhood-expansion to search similar samples for each image from a query expansion set with the semantically invariant features and design a Transformer architecture to adaptively transfer the semantics of neighbor samples to their corresponding images. With the support of semantically invariant features, query expansion set, and adaptive semantic transfer, the representation capability of query hash codes can be enhanced at the online retrieval stage. Experimental results demonstrate that the proposed OQEH method achieves superior retrieval accuracy and comparable retrieval efficiency compared with the state-of-the-art methods. Particularly, on MS COCO dataset, OQEH can obtain about 6% performance improvement compared with the state-of-the-art results. The source codes of our method are available at: https://github.com/christinecui/OQEH.

Field of Experts Optimization-Based Noisy Image Retrieval.

High quality non-blind image deconvolution using the Fields of Experts prior

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

An Adaptive Weight Value-Based Multi-Scale Retinex Algorithm for Color Image Enhancement

Image super-resolution using nonlocally centralized sparse representation and fields of experts priors

AdapNet: Adaptive Noise-Based Network for Low-Quality Image Retrieval

Weighted-learning-instance-based Retrieval Model Using Instance Distance.

Noise Resistant Graph Ranking for Improved Web Image Search

Progressive Image Retrieval with Quality Guarantee under MapReduce Framework

Prototypical Mixing and Retrieval-Based Refinement for Label Noise-Resistant Image Retrieval

Optimal Adaptive Learning For Image Retrieval

Optimizing Image Compression via Joint Learning with Denoising

Sparse Coding Based Few Learning Instances for Image Retrieval

Towards Image Retrieval with Noisy Labels Via Non-deterministic Features

Optimizing Learning in Image Retrieval

A unified optimization based learning method for image retrieval

Online Query Expansion Hashing for Efficient Image Retrieval

Exploration of Image Search Results Quality Assessment

Exploiting Web Images for Fine-Grained Visual Recognition by Eliminating Open-Set Noise and Utilizing Hard Examples

Multi-frame image super-resolution reconstruction based on spatial information weighted fields of experts

Representing Noisy Image Without Denoising