Abstract:Multimodal hashing approaches have gained great success on large-scale cross-modal similarity search applications, due to their appealing computation and storage efficiency. However, it is still a challenge work to design binary codes to represent the original features with good performance in an unsupervised manner. We argue that there are some limitations that need to be further considered for unsupervised multimodal hashing: 1) most existing methods drop the discrete constraints to simplify the optimization, which will cause large quantization error; 2) many methods are sensitive to outliers and noises since they use l(2)-norm in their objective functions which can amplify the errors; and 3) the weight of each modality, which greatly influences the retrieval performance, is manually or empirically determined and may not fully fit the specific training set. The above limitations may significantly degrade the retrieval accuracy of unsupervised multimodal hashing methods. To address these problems, in this paper, a novel hashing model is proposed to efficiently learn robust discrete binary codes, which is referred as Robust and Flexible Discrete Hashing (RFDH). In the proposed RFDH model, binary codes are directly learned based on discrete matrix decomposition, so that the large quantization error caused by relaxation is avoided. Moreover, the l(2,1)-norm is used in the objective function to improve the robustness, such that the learned model is not sensitive to data outliers and noises. In addition, the weight of each modality is adaptively adjusted according to training data. Hence the important modality will get large weights during the hash learning procedure. Owing to above merits of RFDH, it can generate more effective hash codes. Besides, we introduce two kinds of hash function learning methods to project unseen instances into hash codes. Extensive experiments on several well-known large databases demonstrate superior performance of the proposed hash model over most state-of-the-art unsupervised multimodal hashing methods.

High-level Codes and Fine-grained Weights for Online Multi-modal Hashing Retrieval

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Supervised Coarse-to-Fine Semantic Hashing for Cross-Media Retrieval.

A High-Dimensional Sparse Hashing Framework for Cross-Modal Retrieval

High-Dimensional Sparse Cross-Modal Hashing with Fine-Grained Similarity Embedding

Online Multi-modal Hashing with Dynamic Query-adaption

Sequential Discrete Hashing for Scalable Cross-Modality Similarity Retrieval

Deep Multiscale Fusion Hashing for Cross-Modal Retrieval

Adaptive Multi-Modal Fusion Hashing Via Hadamard Matrix

High-order nonlocal Hashing for unsupervised cross-modal retrieval

Robust and Flexible Discrete Hashing for Cross-Modal Similarity Search

Self-supervised Learning-Based Weight Adaptive Hashing for Fast Cross-Modal Retrieval

Fast Discrete Collaborative Multi-Modal Hashing for Large-Scale Multimedia Retrieval

Multi-scale Consistency Deep Lifelong Cross-modal Hashing

Efficient Multi-modal Hashing with Online Query Adaption for Multimedia Retrieval

Fusion-Supervised Deep Cross-Modal Hashing

Asymmetric Supervised Fusion-Oriented Hashing for Cross-Modal Retrieval.

Flexible Multi-modal Hashing for Scalable Multimedia Retrieval

Sparse Multi-Modal Hashing