Abstract:Due to its fast retrieval and storage efficiency capabilities, hashing has been widely used in nearest neighbor retrieval tasks. By using deep learning based techniques, hashing can outperform non-learning based hashing technique in many applications. However, we argue that the current deep learning based hashing methods ignore some critical problems (e.g., the learned hash codes are not discriminative due to the hashing methods being unable to discover rich semantic information and the training strategy having difficulty optimizing the discrete binary codes). In this paper, we propose a novel image hashing method, termed as \textbf{\underline{A}}symmetric \textbf{\underline{D}}eep \textbf{\underline{S}}emantic \textbf{\underline{Q}}uantization (\textbf{ADSQ}). \textbf{ADSQ} is implemented using three stream frameworks, which consist of one \emph{LabelNet} and two \emph{ImgNets}. The \emph{LabelNet} leverages the power of three fully-connected layers, which are used to capture rich semantic information between image pairs. For the two \emph{ImgNets}, they each adopt the same convolutional neural network structure, but with different weights (i.e., asymmetric convolutional neural networks). The two \emph{ImgNets} are used to generate discriminative compact hash codes. Specifically, the function of the \emph{LabelNet} is to capture rich semantic information that is used to guide the two \emph{ImgNets} in minimizing the gap between the real-continuous features and the discrete binary codes. Furthermore, \textbf{ADSQ} can utilize the most critical semantic information to guide the feature learning process and consider the consistency of the common semantic space and Hamming space. Experimental results on three benchmarks (i.e., CIFAR-10, NUS-WIDE, and ImageNet) demonstrate that the proposed \textbf{ADSQ} can outperforms current state-of-the-art methods.

Semantic Preserving Hash Coding Through VAE-GAN.

Deep Hashing Based on VAE-GAN for Efficient Similarity Retrieval

Unsupervised Semantic-Preserving Adversarial Hashing for Image Search.

Progressive Generative Hashing for Image Retrieval

HashGAN: Deep Learning to Hash with Pair Conditional Wasserstein GAN

One Network for Multi-Domains: Domain Adaptive Hashing with Intersectant Generative Adversarial Networks.

Deep Semantic Preserving Hashing for Large Scale Image Retrieval

Integration of Semantic and Visual Hashing for Image Retrieval

Adversarial Multi-Label Variational Hashing

Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval.

Deep Visual-Semantic Hashing for Cross-Modal Retrieval

Hash Learning with Convolutional Neural Networks for Semantic Based Image Retrieval.

A New Ranking Based Semantic Hashing Method for Deep Image Retrieval

CoopHash: Cooperative Learning of Multipurpose Descriptor and Contrastive Pair Generator via Variational MCMC Teaching for Supervised Image Hashing

SSAH: Semi-supervised Adversarial Deep Hashing with Self-paced Hard Sample Generation

Dual enhanced semantic hashing for fast image retrieval

Semantic Binary Coding for Visual Recognition Via Joint Concept-Attribute Modelling.

SSDH: Semi-Supervised Deep Hashing for Large Scale Image Retrieval

WeGAN: Deep Image Hashing with Weighted Generative Adversarial Networks

Asymmetric Deep Semantic Quantization for Image Retrieval

Enhanced Deep Discrete Hashing with semantic-visual similarity for image retrieval