Abstract:Hashing has shown its efficiency and effectiveness in facilitating large-scale multimedia applications. Supervised knowledge (e.g., semantic labels or pair-wise relationship) associated to data is capable of significantly improving the quality of hash codes and hash functions. However, confronted with the rapid growth of newly-emerging concepts and multimedia data on the Web, existing supervised hashing approaches may easily suffer from the scarcity and validity of supervised information due to the expensive cost of manual labelling. In this paper, we propose a novel hashing scheme, termed zero-shot hashing (ZSH), which compresses images of "unseen" categories to binary codes with hash functions learned from limited training data of "seen" categories. Specifically, we project independent data labels (i.e., 0/1-form label vectors) into semantic embedding space, where semantic relationships among all the labels can be precisely characterized and thus seen supervised knowledge can be transferred to unseen classes. Moreover, in order to cope with the semantic shift problem, we rotate the embedded space to more suitably align the embedded semantics with the low-level visual feature space, thereby alleviating the influence of semantic gap. In the meantime, to exert positive effects on learning high-quality hash functions, we further propose to preserve local structural property and discrete nature in binary codes. Besides, we develop an efficient alternating algorithm to solve the ZSH model. Extensive experiments conducted on various real-life datasets show the superior zero-shot image retrieval performance of ZSH as compared to several state-of-the-art hashing methods.

PIXEL: Prompt-based Zero-shot Hashing Via Visual and Textual Semantic Alignment

Attribute-Guided Network for Cross-Modal Zero-Shot Hashing

COMAE: COMprehensive Attribute Exploration for Zero-shot Hashing

Zero-Shot Hashing Via Transferring Supervised Knowledge

Transductive Zero-Shot Hashing for Multilabel Image Retrieval

Semantic Augmentation Hashing for Zero-Shot Image Retrieval.

Zero-shot Discrete Hashing with Adaptive Class Correlation for Cross-Modal Retrieval

Attribute hashing for zero-shot image retrieval

Discrete Asymmetric Zero-Shot Hashing with Application to Cross-Modal Retrieval

Cross-modal Zero-shot Hashing

Zero-shot Leaning and Hashing with Binary Visual Similes

Deep quantization network with visual-semantic alignment for zero-shot image retrieval

Image Retrieval via Balanced and Maximum Variance Deep Hashing.

Enhancing Cross-Modal Retrieval Via Visual-Textual Prompt Hashing

Deep visual-semantic hashing for cross-modal retrieval

Attribute-Guided Multiple Instance Hashing Network for Cross-Modal Zero-Shot Hashing

VSB2-Net: Visual-Semantic Bi-Branch Network for Zero-Shot Hashing

Zero-shot Hashing Via Asymmetric Ratio Similarity Matrix

Learning complementary semantic information for zero-shot recognition

A New Ranking Based Semantic Hashing Method for Deep Image Retrieval