Abstract:In recent years, many achievements have been made in improving the performance of supervised cross-modal hashing. However, it remains an open issue on how to fully explore the data information to achieve fine-grained retrieval performance. Most methods employ logical labels or a binary similarity matrix to supervise the hash learning, losing a lot of useful information. From another point of view, the low expressiveness of dense hash code severely limits its preservation of fine-grained data information. With this motivation, in this paper, we propose a high-dimensional sparse hashing framework for cross-modal retrieval, i.e., High-dimensional Sparse Cross-modal Hashing, HSCH for short. It leverages not only high-level semantic labels but also low-level multi-modal features to construct a fine-grained similarity. In particular, based on two well-designed rules, i.e., multi-level and prioritized, it is able to avoid semantic conflicts. Additionally, it leverages the strong power of high-dimensional sparse hash codes to preserve the fine-grained similarity. Then, it efficiently solves the sparse and discrete constraints of sparse hash codes through an efficient discrete optimization algorithm. In light of this, it is much more efficient and scalable to large-scale datasets. More importantly, the computational complexity of HSCH in the retrieval phase is as efficient as those naive hashing methods that use dense hash codes. Moreover, to support online learning scenarios, this paper also extends HSCH into an online version, i.e., HSCH_on. Extensive experiments on three benchmark datasets demonstrate the superiority of our framework compared with some state-of-the-art cross-modal hashing approaches in terms of both accuracy and efficiency.

Online supervised collective matrix factorization hashing for cross-modal retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Online latent semantic hashing for cross-media retrieval.

Online Collective Matrix Factorization Hashing for Large-Scale Cross-Media Retrieval

Robust Supervised Matrix Factorization Hashing with Application to Cross-Modal Retrieval.

Cross-modal retrieval via label category supervised matrix factorization hashing

Semi-supervised semantic factorization hashing for fast cross-modal retrieval

Efficient Online Label Consistent Hashing for Large-Scale Cross-Modal Retrieval.

Unsupervised Online Cross-modal Hashing with Multiple Association Exploitation

Supervised Hierarchical Online Hashing for Cross-modal Retrieval

Large-Scale Cross-Modality Search via Collective Matrix Factorization Hashing

Semantic Constraints Matrix Factorization Hashing for Cross-Modal Retrieval

Semantic embedding based online cross-modal hashing method

Supervised Intra- and Inter-Modality Similarity Preserving Hashing for Cross-Modal Retrieval.

Supervised Matrix Factorization for Cross-Modality Hashing.

Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

Unsupervised Deep Hashing Via Binary Latent Factor Models for Large-scale Cross-modal Retrieval

Modality-specific Matrix Factorization Hashing for Cross-Modal Retrieval

A High-Dimensional Sparse Hashing Framework for Cross-Modal Retrieval

Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval