Abstract:Most existing cross-modal hashing methods suffer from the scalability issue in the training phase. In this paper, we propose a novel cross-modal hashing approach with a linear time complexity to the training data size, to enable scalable indexing for multimedia search across multiple modals. Taking both the intra-similarity in each modal and the inter-similarity across different modals into consideration, the proposed approach aims at effectively learning hash functions from large-scale training datasets. More specifically, for each modal, we first partition the training data into $k$ clusters and then represent each training data point with its distances to $k$ centroids of the clusters. Interestingly, such a k-dimensional data representation can reduce the time complexity of the training phase from traditional O(n2) or higher to O(n), where $n$ is the training data size, leading to practical learning on large-scale datasets. We further prove that this new representation preserves the intra-similarity in each modal. To preserve the inter-similarity among data points across different modals, we transform the derived data representations into a common binary subspace in which binary codes from all the modals are "consistent" and comparable. nThe transformation simultaneously outputs the hash functions for all modals, which are used to convert unseen data into binary codes. Given a query of one modal, it is first mapped into the binary codes using the modal's hash functions, followed by matching the database binary codes of any other modals. Experimental results on two benchmark datasets confirm the scalability and the effectiveness of the proposed approach in comparison with the state of the art.

Multi-Kernel Hashing With Semantic Correlation Maximization For Cross-Modal Retrieval

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Semantic Consistency Hashing for Cross-Modal Retrieval

Frustratingly Easy Cross-Modal Hashing

Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

Latent semantic-enhanced discrete hashing for cross-modal retrieval

Multi-Relational Deep Hashing for Cross-Modal Search

Cross-modal retrieval based on multi-dimensional feature fusion hashing

An efficient dual semantic preserving hashing for cross-modal retrieval

Correlation Hashing Network for Efficient Cross-Modal Retrieval.

Multi-modal Hashing for Efficient Multimedia Retrieval: A Survey

Cross-media hashing with kernel regression

Multi-Similarity Semantic Correctional Hashing for Cross Modal Retrieval

Large-Scale Supervised Multimodal Hashing with Semantic Correlation Maximization

Linear cross-modal hashing for efficient multimedia search

Deep Cross-Modal Hashing with Fine-Grained Similarity

Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval

Deep Multi-Level Semantic Hashing for Cross-Modal Retrieval

Deep Visual-Semantic Hashing for Cross-Modal Retrieval

Cross-Modal Hashing by Lp-Norm Multiple Subgraph Combination

Latent Semantic Sparse Hashing for Cross-Modal Similarity Search.