Abstract:Due to the high retrieval efficiency and low storage cost for cross-modal search tasks, cross-modal hashing methods have attracted considerable attention from the researchers. For the supervised cross-modal hashing methods, how to make the learned hash codes sufficiently preserve semantic information contained in the label of datapoints is the key to further enhance the retrieval performance. Hence, almost all supervised cross-modal hashing methods usually depend on defining similarities between datapoints with the label information to guide the hashing model learning fully or partly. However, the defined similarity between datapoints can only capture the label information of datapoints partially and misses abundant semantic information, which then hinders the further improvement of retrieval performance. Thus, in this paper, different from previous works, we propose a novel cross-modal hashing method without defining the similarity between datapoints, called Deep Cross-modal Proxy Hashing (DCPH). Specifically, DCPH first trains a proxy hashing network to transform each category information of a dataset into a semantic discriminative hash code, called proxy hash code. Each proxy hash code can preserve the semantic information of its corresponding category well. Next, without defining the similarity between datapoints to supervise the training process of the modality-specific hashing networks, we propose a novel margin-dynamic-softmax loss to directly utilize the proxy hashing codes as supervised information. Finally, by minimizing the novel margin-dynamic-softmax loss, the modality-specific hashing networks can be trained to generate hash codes that can simultaneously preserve the cross-modal similarity and abundant semantic information well. Extensive experiments on three benchmark datasets show that the proposed method outperforms the state-of-the-art baselines in the cross-modal retrieval tasks.

Semantic-enhanced Proxy-guided Hashing for Long-tailed Image Retrieval

Supervised Coarse-to-Fine Semantic Hashing for Cross-Media Retrieval.

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Deep Hashing with Top Similarity Preserving for Image Retrieval

Dual Dynamic Proxy Hashing Network for Long-tailed Image Retrieval

Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval.

Long-Tail Hashing

Self-Distillation Hashing for Efficient Hamming Space Retrieval

Learning discrete class-specific prototypes for deep semantic hashing

Deep Self-Adaptive Hashing for Image Retrieval

SSDH: Semi-Supervised Deep Hashing for Large Scale Image Retrieval

Deep Hashing Using Proxy Loss on Remote Sensing Image Retrieval

Deep Multi-Similarity Hashing with semantic-aware preservation for multi-label image retrieval

Latent semantic-enhanced discrete hashing for cross-modal retrieval

Dual enhanced semantic hashing for fast image retrieval

Deep Self-Learning Hashing for Image Retrieval

Deep Cross-modal Proxy Hashing

Supervised Discrete Multiple-Length Hashing for Image Retrieval

Query-Adaptive Image Retrieval by Deep-Weighted Hashing

Enhanced Deep Discrete Hashing with semantic-visual similarity for image retrieval

An efficient dual semantic preserving hashing for cross-modal retrieval