Abstract:Hashing-based cross-modal retrieval methods have become increasingly popular due to their advantages in storage and speed. While current methods have demonstrated impressive results, there are still several issues that have not been addressed. Specifically, many of these approaches assume that labels are perfectly assigned, despite the fact that in real-world scenarios, labels are often incomplete or partially missing. There are two reasons for this, as manual labeling can be a complex and time-consuming task, and annotators may only be interested in certain objects. As such, cross-modal retrieval with missing labels is a significant challenge that requires further attention. Moreover, the similarity between labels is frequently ignored, which is important for exploring the high-level semantics of labels. To address these limitations, we propose a novel method called Cross-Modal Hashing with Missing Labels (CMHML). Our method consists of several key components. First, we introduce Reliable Label Learning to preserve reliable information from the observed labels. Next, to infer the uncertain part of the predicted labels, we decompose the predicted labels into latent representations of labels and samples. The representation of samples is extracted from different modalities, which assists in inferring missing labels. We also propose Label Correlation Preservation to enhance the similarity between latent representations of labels. Hash codes are then learned from the representation of samples through Global Approximation Learning. We also construct a similarity matrix according to predicted labels and embed it into hash codes learning to explore the value of labels. Finally, we train linear classifiers to map original samples to a low-dimensional Hamming space. To evaluate the efficacy of CMHML, we conduct extensive experiments on four publicly available datasets. Our method is compared to other state-of-the-art methods, and the results demonstrate that our model performs competitively even when most labels are missing.

Multi-Level Correlation Adversarial Hashing for Cross-Modal Retrieval.

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Multi-Task Consistency-Preserving Adversarial Hashing for Cross-Modal Retrieval

Adaptive Marginalized Semantic Hashing for Unpaired Cross-Modal Retrieval

Correlation Hashing Network for Efficient Cross-Modal Retrieval.

Multi-Relational Deep Hashing for Cross-Modal Search

Deep Cross-Modal Hashing with Multi-Task Latent Space Learning

Adversary Guided Asymmetric Hashing for Cross-Modal Retrieval

Adaptive Label Correlation Based Asymmetric Discrete Hashing for Cross-modal Retrieval

Multi-level Adversarial Attention Cross-Modal Hashing

Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval

Asymmetric Correlation Quantization Hashing for Cross-modal Retrieval

Dual Semantic Fusion Hashing for Multi-Label Cross-Modal Retrieval

LCEMH: Label Correlation Enhanced Multi-modal Hashing for Efficient Multi-modal Retrieval

Deep Semantic Correlation Learning Based Hashing for Multimedia Cross-Modal Retrieval

Label Guided Correlation Hashing for Large-Scale Cross-Modal Retrieval

Unsupervised Adaptive Hypergraph Correlation Hashing for Multimedia Retrieval

Sequential Cross-Modal Hashing Learning Via Multi-scale Correlation Mining

Multi-level Similarity Complementary Fusion for Unsupervised Cross-Modal Hashing

Cross-modal hashing with missing labels

Asymmetric Low-Rank Double-Level Cooperation for Scalable Discrete Cross-Modal Hashing.