Abstract:Hashing technology has exhibited great cross-modal retrieval potential due to its appealing retrieval efficiency and storage effectiveness. Most current supervised cross-modal retrieval methods heavily rely on accurate semantic supervision, which is intractable for annotations with ever-growing sample sizes. By comparison, the existing unsupervised methods rely on accurate sample similarity preservation strategies with intensive computational costs to compensate for the lack of semantic guidance, which causes these methods to lose the power to bridge the semantic gap. Furthermore, both kinds of approaches need to search for the nearest samples among all samples in a large search space, whose process is laborious. To address these issues, this paper proposes an unsupervised dual deep hashing (UDDH) method with semantic-index and content-code for cross-modal retrieval. Deep hashing networks are utilized to extract deep features and jointly encode the dual hashing codes in a collaborative manner with a common semantic index and modality content codes to simultaneously bridge the semantic and heterogeneous gaps for cross-modal retrieval. The dual deep hashing architecture, comprising the head code on semantic index and tail codes on modality content, enhances the efficiency for cross-modal retrieval. A query sample only needs to search for the retrieved samples with the same semantic index, thus greatly shrinking the search space and achieving superior retrieval efficiency. UDDH integrates the learning processes of deep feature extraction, binary optimization, common semantic index, and modality content code within a unified model, allowing for collaborative optimization to enhance the overall performance. Extensive experiments are conducted to demonstrate the retrieval superiority of the proposed approach over the state-of-the-art baselines.

Pairwise Relationship Guided Deep Hashing for Cross-Modal Retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Discrete Similarity Preserving Hashing for Cross-modal Retrieval.

Frustratingly Easy Cross-Modal Hashing

Semantic Consistency Hashing for Cross-Modal Retrieval

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Multi-Relational Deep Hashing for Cross-Modal Search

Triplet-Based Deep Hashing Network for Cross-Modal Retrieval

Deep Cross-Modal Hashing With Hashing Functions and Unified Hash Codes Jointly Learning

Deep Cross-Modal Hashing with Fine-Grained Similarity

Discrete Two-Step Cross-Modal Hashing Through the Exploitation of Pairwise Relations

Deep Class-guided Hashing for Multi-label Cross-modal Retrieval

Deep Semantic-Alignment Hashing for Unsupervised Cross-Modal Retrieval

Deep Visual-Semantic Hashing for Cross-Modal Retrieval

Correlation Hashing Network for Efficient Cross-Modal Retrieval.

A High-Dimensional Sparse Hashing Framework for Cross-Modal Retrieval

Deep Adaptively-Enhanced Hashing With Discriminative Similarity Guidance for Unsupervised Cross-Modal Retrieval

Deep Neighborhood-aware Proxy Hashing with Uniform Distribution Constraint for Cross-modal Retrieval

Deep Manifold Hashing: A Divide-and-Conquer Approach for Semi-Paired Unsupervised Cross-Modal Retrieval

Unsupervised Dual Deep Hashing with Semantic-Index and Content-Code for Cross-Modal Retrieval