Abstract:Hashing technology has exhibited great cross-modal retrieval potential due to its appealing retrieval efficiency and storage effectiveness. Most current supervised cross-modal retrieval methods heavily rely on accurate semantic supervision, which is intractable for annotations with ever-growing sample sizes. By comparison, the existing unsupervised methods rely on accurate sample similarity preservation strategies with intensive computational costs to compensate for the lack of semantic guidance, which causes these methods to lose the power to bridge the semantic gap. Furthermore, both kinds of approaches need to search for the nearest samples among all samples in a large search space, whose process is laborious. To address these issues, this paper proposes an unsupervised dual deep hashing (UDDH) method with semantic-index and content-code for cross-modal retrieval. Deep hashing networks are utilized to extract deep features and jointly encode the dual hashing codes in a collaborative manner with a common semantic index and modality content codes to simultaneously bridge the semantic and heterogeneous gaps for cross-modal retrieval. The dual deep hashing architecture, comprising the head code on semantic index and tail codes on modality content, enhances the efficiency for cross-modal retrieval. A query sample only needs to search for the retrieved samples with the same semantic index, thus greatly shrinking the search space and achieving superior retrieval efficiency. UDDH integrates the learning processes of deep feature extraction, binary optimization, common semantic index, and modality content code within a unified model, allowing for collaborative optimization to enhance the overall performance. Extensive experiments are conducted to demonstrate the retrieval superiority of the proposed approach over the state-of-the-art baselines.

Unsupervised Dual Hashing Coding (UDC) on Semantic Tagging and Sample Content for Cross-modal Retrieval

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Semantic Consistency Hashing for Cross-Modal Retrieval

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Unsupervised Dual Deep Hashing with Semantic-Index and Content-Code for Cross-Modal Retrieval

Deep Semantic-Alignment Hashing for Unsupervised Cross-Modal Retrieval

Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

UCMH: Unpaired cross-modal hashing with matrix factorization

Dual Variational Network for Unsupervised Cross-Modal Hashing

Unsupervised Deep Hashing Via Binary Latent Factor Models for Large-scale Cross-modal Retrieval

Sequential Discrete Hashing for Scalable Cross-Modality Similarity Retrieval

Deep Cross-Modal Supervised Hashing Based on Joint Semantic Matrix

An efficient dual semantic preserving hashing for cross-modal retrieval

Completely Unpaired Cross-Modal Hashing Based on Coupled Subspace

Dual Semantic Fusion Hashing for Multi-Label Cross-Modal Retrieval

Unsupervised Cross-modal Hashing via Semantic Text Mining

Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval

Cross-Domain Transfer Hashing for Efficient Cross-modal Retrieval

Unsupervised Joint-Semantics Autoencoder Hashing for Multimedia Retrieval