Abstract:Cross-modal hashing aims to map heterogeneous cross-modal data into a common Hamming space, which can realize fast and flexible retrieval across different modalities. Unsupervised cross-modal hashing is more flexible and applicable than supervised methods, since no intensive labeling work is involved. However, existing unsupervised methods learn the hashing functions by preserving inter- and intra-correlations while ignoring the underlying manifold structure across different modalities, which is extremely helpful in capturing the meaningful nearest neighbors of different modalities for cross-modal retrieval. Furthermore, existing works mainly focus on pairwise relation modeling while ignoring the correlations within multiple modalities. To address the above-mentioned problems, in this paper, we propose a multi-pathway generative adversarial hashing approach for unsupervised cross-modal retrieval, which makes full use of a generative adversarial network's ability for unsupervised representation learning to exploit the underlying manifold structure of cross-modal data. The main contributions can be summarized as follows: First, we propose a multi-pathway generative adversarial network to model cross-modal hashing in an unsupervised fashion. In the proposed network, given the data of one modality, the generative model tries to fit the distribution over the manifold structure and selects informative data of other modalities to challenge the discriminative model. The discriminative model learns to distinguish the generated data and the true positive data sampled from the correlation graph to achieve better retrieval accuracy. These two models are trained in an adversarial way to improve each other and promote hashing function learning. Second, we propose a correlation graph-based approach to capture t-e underlying manifold structure across different modalities so that data of different modalities but within the same manifold can have a smaller Hamming distance to promote retrieval accuracy. Extensive experiments compared with state-of-the-art methods on three widely used datasets verify the effectiveness of our proposed approach.

Semi-supervised Cross-Modal Hashing with Multi-View Graph Representation

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Aggregation-Based Graph Convolutional Hashing for Unsupervised Cross-Modal Retrieval

Semi-Supervised Graph Convolutional Hashing Network for Large-Scale Cross-Modal Retrieval

Graph Convolutional Multi-Label Hashing for Cross-Modal Retrieval

Graph Convolutional Network Hashing for Cross-Modal Retrieval

Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

MS2GAH: Multi-label Semantic Supervised Graph Attention Hashing for Robust Cross-Modal Retrieval

Semi-supervised Semi-paired Cross-modal Hashing

SCH-GAN: Semi-Supervised Cross-Modal Hashing by Generative Adversarial Network

Multi-Pathway Generative Adversarial Hashing for Unsupervised Cross-Modal Retrieval

Unsupervised Generative Adversarial Cross-Modal Hashing

Cross-Modal Hashing by Lp-Norm Multiple Subgraph Combination

Three-Stage Semisupervised Cross-Modal Hashing With Pairwise Relations Exploitation

Multiview Graph Convolutional Hashing for Multisource Remote Sensing Image Retrieval

Collaborative Subspace Graph Hashing for Cross-modal Retrieval

Semantic-rebased cross-modal hashing for scalable unsupervised text-visual retrieval

A High-Dimensional Sparse Hashing Framework for Cross-Modal Retrieval

Large-Scale Cross-Modality Search via Collective Matrix Factorization Hashing

Multi-Relational Deep Hashing for Cross-Modal Search