Abstract:Cross-modal hashing aims to map heterogeneous multimedia data into a common Hamming space, which can realize fast and flexible retrieval across different modalities. Unsupervised cross-modal hashing is more flexible and applicable than supervised methods, since no intensive labeling work is involved. However, existing unsupervised methods learn hashing functions by preserving inter and intra correlations, while ignoring the underlying manifold structure across different modalities, which is extremely helpful to capture meaningful nearest neighbors of different modalities for cross-modal retrieval. To address the above problem, in this paper we propose an Unsupervised Generative Adversarial Cross-modal Hashing approach (UGACH), which makes full use of GAN's ability for unsupervised representation learning to exploit the underlying manifold structure of cross-modal data. The main contributions can be summarized as follows: (1) We propose a generative adversarial network to model cross-modal hashing in an unsupervised fashion. In the proposed UGACH, given a data of one modality, the generative model tries to fit the distribution over the manifold structure, and select informative data of another modality to challenge the discriminative model. The discriminative model learns to distinguish the generated data and the true positive data sampled from correlation graph to achieve better retrieval accuracy. These two models are trained in an adversarial way to improve each other and promote hashing function learning. (2) We propose a correlation graph based approach to capture the underlying manifold structure across different modalities, so that data of different modalities but within the same manifold can have smaller Hamming distance and promote retrieval accuracy. Extensive experiments compared with 6 state-of-the-art methods on 2 widely-used datasets verify the effectiveness of our proposed approach.

Maximum Variance Hashing Via Column Generation

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Weakly Principal Component Hashing with Multiple Tables.

Learning Hash Functions Using Column Generation.

Harmonious Hashing

Binary Multidimensional Scaling for Hashing

Structured Learning of Binary Codes with Column Generation.

Structured Learning of Binary Codes with Column Generation for Optimizing Ranking Measures

Maximum-Margin Hamming Hashing

Hashing on nonlinear manifolds.

Unsupervised Discriminative Hashing

Learning a maximized shared latent factor for cross-modal hashing

Multi-View Latent Hashing for Efficient Multimedia Search

Unsupervised Generative Adversarial Cross-Modal Hashing

Variable Length Deep Cross-Modal Hashing Based on Cauchy Probability Function

Sparse-Inductive Generative Adversarial Hashing for Nearest Neighbor Search

Large-Scale Unsupervised Hashing with Shared Structure Learning

Multiview Discrete Hashing for Scalable Multimedia Search

Document Hashing with Mixture-Prior Generative Models

Supervised Discrete Hashing with Mutual Linear Regression.

Efficient Learning for Hashing Proportional Data