Abstract:For many large-scale multimedia datasets and web contents, the nearest neighbor search methods based on the hashing strategy for cross-modal retrieval have attracted considerable attention due to its fast query speed and low storage cost. Most existing hashing methods try to map different modalities to Hamming embedding in a supervised way where the semantic information comes from a large manual label matrix and each sample in different modalities is usually encoded by a sparse label vector. However, previous studies didn't address the semantic correlation learning challenges and couldn't make the best use of the prior semantic information. Therefore, they cannot preserve the accurate semantic similarities and often degrade the performance of hashing function learning. To fill this gap, we firstly proposed a novel Deep Semantic Correlation learning based Hashing framework (DSCH) that generates unified hash codes in an end-to-end deep learning architecture for cross-modal retrieval task. The major contribution in this work is to effectively automatically construct the semantic correlation between data representation and demonstrate how to utilize correlation information to generate hash codes for new samples. In particular, DSCH integrates latent semantic embedding with a unified hash embedding to strengthen the similarity information among multiple modalities. Furthermore, additional graph regularization is employed in our framework, to capture the correspondences from the inter-modal and intra-modal. Our model simultaneously learns the semantic correlation and the unified hash codes, which enhances the effectiveness of cross-modal retrieval task. Experimental results show the superior accuracy of our proposed approach to several state-of-the-art cross-modality methods on two large datasets.

Domain Uncertainty Based on Information Theory for Cross-Modal Hash Retrieval

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Discrete Similarity Preserving Hashing for Cross-modal Retrieval.

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

One Network for Multi-Domains: Domain Adaptive Hashing with Intersectant Generative Adversarial Networks.

Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

Variable Length Deep Cross-Modal Hashing Based on Cauchy Probability Function

Correlation Hashing Network for Efficient Cross-Modal Retrieval.

Pseudo-label driven deep hashing for unsupervised cross-modal retrieval

Dual Variational Network for Unsupervised Cross-Modal Hashing

Pairwise Relationship Guided Deep Hashing for Cross-Modal Retrieval

Cross-Domain Transfer Hashing for Efficient Cross-modal Retrieval

Discriminant Cross-modal Hashing

Unsupervised Deep Cross-modal Hashing with Virtual Label Regression

Work Together: Correlation-Identity Reconstruction Hashing for Unsupervised Cross-modal Retrieval

Deep Semantic Correlation Learning Based Hashing for Multimedia Cross-Modal Retrieval

Global and Local Semantics-Preserving Based Deep Hashing for Cross-Modal Retrieval

Deep Multi-Level Semantic Hashing for Cross-Modal Retrieval

Two-Step Discrete Hashing for Cross-Modal Retrieval

Triplet-Based Deep Hashing Network for Cross-Modal Retrieval

Cross-modal retrieval based on multi-dimensional feature fusion hashing