Abstract:For many large-scale multimedia datasets and web contents, the nearest neighbor search methods based on the hashing strategy for cross-modal retrieval have attracted considerable attention due to its fast query speed and low storage cost. Most existing hashing methods try to map different modalities to Hamming embedding in a supervised way where the semantic information comes from a large manual label matrix and each sample in different modalities is usually encoded by a sparse label vector. However, previous studies didn't address the semantic correlation learning challenges and couldn't make the best use of the prior semantic information. Therefore, they cannot preserve the accurate semantic similarities and often degrade the performance of hashing function learning. To fill this gap, we firstly proposed a novel Deep Semantic Correlation learning based Hashing framework (DSCH) that generates unified hash codes in an end-to-end deep learning architecture for cross-modal retrieval task. The major contribution in this work is to effectively automatically construct the semantic correlation between data representation and demonstrate how to utilize correlation information to generate hash codes for new samples. In particular, DSCH integrates latent semantic embedding with a unified hash embedding to strengthen the similarity information among multiple modalities. Furthermore, additional graph regularization is employed in our framework, to capture the correspondences from the inter-modal and intra-modal. Our model simultaneously learns the semantic correlation and the unified hash codes, which enhances the effectiveness of cross-modal retrieval task. Experimental results show the superior accuracy of our proposed approach to several state-of-the-art cross-modality methods on two large datasets.

Supervised Semantic-Embedded Hashing for Multimedia Retrieval

Supervised Coarse-to-Fine Semantic Hashing for Cross-Media Retrieval.

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Online latent semantic hashing for cross-media retrieval.

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Scalable Multimedia Retrieval By Deep Learning Hashing With Relative Similarity Learning

Supervised Hashing With Pseudo Labels For Scalable Multimedia Retrieval

Multi-modal Hashing for Efficient Multimedia Retrieval: A Survey

Latent semantic-enhanced discrete hashing for cross-modal retrieval

Seg-Hashnet: Semantic Segmentation Based Unsupervised Hashing

Efficient Semi-Supervised Multimodal Hashing With Importance Differentiation Regression

Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

Fast Discrete Collaborative Multi-Modal Hashing for Large-Scale Multimedia Retrieval

Efficient Supervised Discrete Multi-View Hashing for Large-Scale Multimedia Search

Efficient Multi-modal Hashing with Online Query Adaption for Multimedia Retrieval

Multi-modal discrete tensor decomposition hashing for efficient multimedia retrieval

Guided Hash Algorithm for Information Semantic Retrieval in Multimedia Environment

One for more: Structured Multi-Modal Hashing for multiple multimedia retrieval tasks

Discrete Semantic Alignment Hashing for Cross-Media Retrieval

Deep Semantic Correlation Learning Based Hashing for Multimedia Cross-Modal Retrieval

Semantic embedding based online cross-modal hashing method