Abstract:Cross-modal hashing has been widely used in multimedia retrieval tasks due to its fast retrieval speed and low storage cost. Recently, many deep unsupervised cross-modal hashing methods have been proposed to deal the unlabeled datasets. These methods usually construct an instance similarity matrix by fusing the image and text modality-specific similarity matrices as the guiding information to train the hashing networks. However, most of them directly use cosine similarities between the bag-of-words (BoW) vectors of text datapoints to define the text modality-specific similarity matrix, which fails to mine the semantic similarity information contained in the text modal datapoints and leads to the poor quality of the instance similarity matrix. To tackle the aforementioned problem, in this paper, we propose a novel Unsupervised Cross-modal Hashing via Semantic Text Mining, called UCHSTM. Specifically, UCHSTM first mines the correlations between the words of text datapoints. Then, UCHSTM constructs the text modality-specific similarity matrix for the training instances based on the mined correlations between their words. Next, UCHSTM fuses the image and text modality-specific similarity matrices as the final instance similarity matrix to guide the training of hashing model. Furthermore, during the process of training the hashing networks, a novel self-redefined-similarity loss is proposed to further correct some wrong defined similarities in the constructed instance similarity matrix, thereby further enhancing the retrieval performance. Extensive experiments on two widely used datasets show that the proposed UCHSTM outperforms state-of-the-art baselines on cross-modal retrieval tasks. We provide our source codes at: https://github.com/rongchengtu1/UCHTIM.

Hypergraph-Enhanced Hashing for Unsupervised Cross-Modal Retrieval via Robust Similarity Guidance

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Semantic Consistency Hashing for Cross-Modal Retrieval

Aggregation-Based Graph Convolutional Hashing for Unsupervised Cross-Modal Retrieval

Unsupervised Adaptive Hypergraph Correlation Hashing for Multimedia Retrieval

Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

High-order nonlocal Hashing for unsupervised cross-modal retrieval

Semi-supervised Cross-Modal Hashing with Multi-View Graph Representation

From Sparse to Dense: Semantic Graph Evolutionary Hashing for Unsupervised Cross-Modal Retrieval.

Unsupervised Concatenation Hashing Via Combining Subspace Learning and Graph Embedding for Cross-Modal Image Retrieval

Unsupervised Cross-modal Hashing via Semantic Text Mining

Comprehensive Graph-conditional Similarity Preserving Network for Unsupervised Cross-modal Hashing

Attention-Guided Semantic Hashing for Unsupervised Cross-Modal Retrieval

Graph Convolutional Network Hashing for Cross-Modal Retrieval

Unsupervised deep hashing with multiple similarity preservation for cross-modal image-text retrieval

Proxy-based Graph Convolutional Hashing for Cross-Modal Retrieval

Self-Supervised Multi-Modal Knowledge Graph Contrastive Hashing for Cross-Modal Search

Supervised Intra- and Inter-Modality Similarity Preserving Hashing for Cross-Modal Retrieval.

Graph Convolutional Network Based Unsupervised Cross-Modal Hashing Retrieval