Abstract:Driven by the high nonlinearity of deep neural networks, deep hashing has achieved the pictured great potential in cross-modal retrieval applications, significantly bridging the modality gap. Current deep cross-modal hashing usually utilizes affinity matching or local ranking to capture the local semantic relationships in the learned common space, leading to high neighborhood ambiguity. Simultaneously, most of these frameworks utilize additional regularization terms or margin thresholds to enhance the overall performance, in which searching the model's hyper-parameters under mass training data would have a substantial overhead. In this paper, with a novel extension of information-theoretic measures, a novel deep cross-modal hashing method, named Deep Neighborhood-preserving Hashing (DNpH), is designed to learn a highly separable discrete space, effectively mitigating the semantic gap across different modalities. Specifically, to minimize neighborhood ambiguity, the Quadratic Spherical Mutual Information (QSMI) is first introduced into deep cross-modal hashing to separate neighbors and non-neighbors well, while it is free of tuning parameters during model training compared with other similarity measures. To optimize quadratic mutual information loss smoothly, a square clamping method is developed to improve the stability of model optimization, avoiding converging on bad local optimum. Besides, two transformer encoders are exploited as feature extractors for multi-modal samples to learn the informative semantic representations. Finally, we compare our proposed DNpH framework with various state-of-the-art cross-modal hashing on four public datasets, and large amounts of experiment results demonstrate our contributions and show that DNpH outperforms the compared baselines on different evaluation metrics. The corresponding code is available at https://github.com/QinLab-WFU/DNpH.

DAP2CMH: Deep Adversarial Privacy-Preserving Cross-Modal Hashing

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Multi-Task Consistency-Preserving Adversarial Hashing for Cross-Modal Retrieval

Dual-Pathway Deep Hashing Based Adversarial Learning for Cross-modal Retrieval

Deep Class-guided Hashing for Multi-label Cross-modal Retrieval

Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval

Deep Cross-Modal Hashing with Multi-Task Latent Space Learning

Multi-Level Correlation Adversarial Hashing for Cross-Modal Retrieval.

Dual Deep Neural Networks Cross-Modal Hashing

Triplet-Based Deep Hashing Network for Cross-Modal Retrieval

Adversary Guided Asymmetric Hashing for Cross-Modal Retrieval

Dual Self-Paced Cross-Modal Hashing

Fast Discrete Collaborative Multi-Modal Hashing for Large-Scale Multimedia Retrieval

Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval

Multi-Relational Deep Hashing for Cross-Modal Search

Clustering-driven Deep Adversarial Hashing for scalable unsupervised cross-modal retrieval

Deep Neighborhood-preserving Hashing with Quadratic Spherical Mutual Information for Cross-modal Retrieval

Adaptive Marginalized Semantic Hashing for Unpaired Cross-Modal Retrieval

Discrete Fusion Adversarial Hashing for Cross-Modal Retrieval

Deep Discrete Cross-Modal Hashing with Multiple Supervision

Multi-level Adversarial Attention Cross-Modal Hashing