Abstract:Most existing cross-modal hashing methods suffer from the scalability issue in the training phase. In this paper, we propose a novel cross-modal hashing approach with a linear time complexity to the training data size, to enable scalable indexing for multimedia search across multiple modals. Taking both the intra-similarity in each modal and the inter-similarity across different modals into consideration, the proposed approach aims at effectively learning hash functions from large-scale training datasets. More specifically, for each modal, we first partition the training data into $k$ clusters and then represent each training data point with its distances to $k$ centroids of the clusters. Interestingly, such a k-dimensional data representation can reduce the time complexity of the training phase from traditional O(n2) or higher to O(n), where $n$ is the training data size, leading to practical learning on large-scale datasets. We further prove that this new representation preserves the intra-similarity in each modal. To preserve the inter-similarity among data points across different modals, we transform the derived data representations into a common binary subspace in which binary codes from all the modals are "consistent" and comparable. nThe transformation simultaneously outputs the hash functions for all modals, which are used to convert unseen data into binary codes. Given a query of one modal, it is first mapped into the binary codes using the modal's hash functions, followed by matching the database binary codes of any other modals. Experimental results on two benchmark datasets confirm the scalability and the effectiveness of the proposed approach in comparison with the state of the art.

Collective Matrix Factorization Hashing for Multimodal Data

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Frustratingly Easy Cross-Modal Hashing

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Large-Scale Cross-Modality Search via Collective Matrix Factorization Hashing

MTFH: A Matrix Tri-Factorization Hashing Framework for Efficient Cross-Modal Retrieval

Parametric Local Multimodal Hashing for Cross-View Similarity Search

Unsupervised Deep Hashing Via Binary Latent Factor Models for Large-scale Cross-modal Retrieval

Discriminative Supervised Hashing for Cross-Modal similarity Search

Sequential Discrete Hashing for Scalable Cross-Modality Similarity Retrieval

Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval

Discrete Latent Factor Model for Cross-Modal Hashing

Online Collective Matrix Factorization Hashing for Large-Scale Cross-Media Retrieval

Online supervised collective matrix factorization hashing for cross-modal retrieval

Fast Discrete Collaborative Multi-Modal Hashing for Large-Scale Multimedia Retrieval

Flexible Cross-Modal Hashing

Cross-Modal Hashing by Lp-Norm Multiple Subgraph Combination

Sparse Multi-Modal Hashing

Multi-Relational Deep Hashing for Cross-Modal Search

Linear cross-modal hashing for efficient multimedia search