Abstract:Multimodal hashing approaches have gained great success on large-scale cross-modal similarity search applications, due to their appealing computation and storage efficiency. However, it is still a challenge work to design binary codes to represent the original features with good performance in an unsupervised manner. We argue that there are some limitations that need to be further considered for unsupervised multimodal hashing: 1) most existing methods drop the discrete constraints to simplify the optimization, which will cause large quantization error; 2) many methods are sensitive to outliers and noises since they use l(2)-norm in their objective functions which can amplify the errors; and 3) the weight of each modality, which greatly influences the retrieval performance, is manually or empirically determined and may not fully fit the specific training set. The above limitations may significantly degrade the retrieval accuracy of unsupervised multimodal hashing methods. To address these problems, in this paper, a novel hashing model is proposed to efficiently learn robust discrete binary codes, which is referred as Robust and Flexible Discrete Hashing (RFDH). In the proposed RFDH model, binary codes are directly learned based on discrete matrix decomposition, so that the large quantization error caused by relaxation is avoided. Moreover, the l(2,1)-norm is used in the objective function to improve the robustness, such that the learned model is not sensitive to data outliers and noises. In addition, the weight of each modality is adaptively adjusted according to training data. Hence the important modality will get large weights during the hash learning procedure. Owing to above merits of RFDH, it can generate more effective hash codes. Besides, we introduce two kinds of hash function learning methods to project unseen instances into hash codes. Extensive experiments on several well-known large databases demonstrate superior performance of the proposed hash model over most state-of-the-art unsupervised multimodal hashing methods.

Cross-Modality Binary Code Learning Via Fusion Similarity Hashing

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Frustratingly Easy Cross-Modal Hashing

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Learning unified binary codes for cross-modal retrieval via latent semantic hashing.

Learning Discriminative Binary Codes for Large-scale Cross-modal Retrieval

Sequential Discrete Hashing for Scalable Cross-Modality Similarity Retrieval

Fusion-Supervised Deep Cross-Modal Hashing

Learning Binary Codes for Hashing via Feature Decomposition

Fast Cross-Modal Hashing With Global and Local Similarity Embedding

Multimodal Discriminative Binary Embedding for Large-Scale Cross-Modal Retrieval.

Dense Auto-Encoder Hashing for Robust Cross-Modality Retrieval

Towards Optimal Binary Code Learning Via Ordinal Embedding

Cross-modal retrieval based on multi-dimensional feature fusion hashing

Fast Unmediated Hashing for Cross-Modal Retrieval.

Learning compact binary code based on multiple heterogeneous features

Multi-level Similarity Complementary Fusion for Unsupervised Cross-Modal Hashing

Learning a Cross-Modal Hashing Network for Multimedia Search.

Efficient Cross-Modal Retrieval via Deep Binary Hashing and Quantization

Discrete Sparse Hashing For Cross-Modal Similarity Search

Robust and Flexible Discrete Hashing for Cross-Modal Similarity Search