Abstract:Most existing cross-modal hashing methods suffer from the scalability issue in the training phase. In this paper, we propose a novel cross-modal hashing approach with a linear time complexity to the training data size, to enable scalable indexing for multimedia search across multiple modals. Taking both the intra-similarity in each modal and the inter-similarity across different modals into consideration, the proposed approach aims at effectively learning hash functions from large-scale training datasets. More specifically, for each modal, we first partition the training data into $k$ clusters and then represent each training data point with its distances to $k$ centroids of the clusters. Interestingly, such a k-dimensional data representation can reduce the time complexity of the training phase from traditional O(n2) or higher to O(n), where $n$ is the training data size, leading to practical learning on large-scale datasets. We further prove that this new representation preserves the intra-similarity in each modal. To preserve the inter-similarity among data points across different modals, we transform the derived data representations into a common binary subspace in which binary codes from all the modals are "consistent" and comparable. nThe transformation simultaneously outputs the hash functions for all modals, which are used to convert unseen data into binary codes. Given a query of one modal, it is first mapped into the binary codes using the modal's hash functions, followed by matching the database binary codes of any other modals. Experimental results on two benchmark datasets confirm the scalability and the effectiveness of the proposed approach in comparison with the state of the art.

Cross-Modal Discrete Hashing.

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Frustratingly Easy Cross-Modal Hashing

Discrete Similarity Preserving Hashing for Cross-modal Retrieval.

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Learning a Cross-Modal Hashing Network for Multimedia Search.

Learning Discriminative Binary Codes for Large-scale Cross-modal Retrieval

Sequential Discrete Hashing for Scalable Cross-Modality Similarity Retrieval

Discriminant Cross-modal Hashing

Two-Step Discrete Hashing for Cross-Modal Retrieval

Discrete Sparse Hashing For Cross-Modal Similarity Search

Cross-Modal Deep Variational Hashing

Linear cross-modal hashing for efficient multimedia search

Enhanced Discrete Multi-Modal Hashing: More Constraints Yet Less Time to Learn

Discrete Two-Step Cross-Modal Hashing Through the Exploitation of Pairwise Relations

Flexible Cross-Modal Hashing

Discrete Latent Factor Model for Cross-Modal Hashing

Discriminative Supervised Hashing for Cross-Modal similarity Search

Cross-modal image–text search via Efficient Discrete Class Alignment Hashing

Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval