Abstract:This article defines a new hashing task motivated by real-world applications in content-based image retrieval, that is, effective data indexing and retrieval given mixed query (query image together with user-provided keywords). Our work is distinguished from state-of-the-art hashing research by two unique features: (1) Unlike conventional image retrieval systems, the input query is a combination of an exemplar image and several descriptive keywords, and (2) the input image data are often associated with multiple labels. It is an assumption that is more consistent with the realistic scenarios. The mixed image-keyword query significantly extends traditional image-based query and better explicates the user intention. Meanwhile it complicates semantics-based indexing on the multilabel data. Though several existing hashing methods can be adapted to solve the indexing task, unfortunately they all prove to suffer from low effectiveness. To enhance the hashing efficiency, we propose a novel scheme “boosted shared hashing”. Unlike prior works that learn the hashing functions on either all image labels or a single label, we observe that the hashing function can be more effective if it is designed to index over an optimal label subset. In other words, the association between labels and hash bits are moderately sparse. The sparsity of the bit-label association indicates greatly reduced computation and storage complexities for indexing a new sample, since only limited number of hashing functions will become active for the specific sample. We develop a Boosting style algorithm for simultaneously optimizing both the optimal label subsets and hashing functions in a unified formulation, and further propose a query-adaptive retrieval mechanism based on hash bit selection for mixed queries, no matter whether or not the query words exist in the training data. Moreover, we show that the proposed method can be easily extended to the case where the data similarity is gauged by nonlinear kernel functions. Extensive experiments are conducted on standard image benchmarks like CIFAR-10, NUS-WIDE and a-TRECVID. The results validate both the sparsity of the bit-label association and the convergence of the proposed algorithm, and demonstrate that the proposed hashing scheme achieves substantially superior performances over state-of-the-art methods under the same hash bit budget.

Discrepancy and Structure-based Contrast for Test-time Adaptive Retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Discrete Similarity Preserving Hashing for Cross-modal Retrieval.

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

DANCE: Learning A Domain Adaptive Framework for Deep Hashing

Deep Adaptively-Enhanced Hashing With Discriminative Similarity Guidance for Unsupervised Cross-Modal Retrieval

Domain Adaptation Preconceived Hashing for Unconstrained Visual Retrieval

Towards Discriminability with Distribution Discrepancy Constrains for Multisource Domain Adaptation

One Network for Multi-Domains: Domain Adaptive Hashing with Intersectant Generative Adversarial Networks.

Toward Effective Domain Adaptive Retrieval

Sequential Discrete Hashing for Scalable Cross-Modality Similarity Retrieval

Multi-Manifold Deep Discriminative Cross-Modal Hashing for Medical Image Retrieval

Mixed Image-Keyword Query Adaptive Hashing over Multilabel Images

Adaptive Label Correlation Based Asymmetric Discrete Hashing for Cross-modal Retrieval

Deep Self-Adaptive Hashing for Image Retrieval

Scalable Discrete and Asymmetric Unequal Length Hashing Learning for Cross-Modal Retrieval

IDEA: an Invariant Perspective for Efficient Domain Adaptive Image Retrieval

Discriminative Codebook Hashing for Supervised Video Retrieval

Fast Discrete Cross-modal Hashing with Regressing from Semantic Labels.

Strongly Constrained Discrete Hashing