Abstract:Due to its fast retrieval and storage efficiency capabilities, hashing has been widely used in nearest neighbor retrieval tasks. By using deep learning based techniques, hashing can outperform non-learning based hashing technique in many applications. However, we argue that the current deep learning based hashing methods ignore some critical problems (e.g., the learned hash codes are not discriminative due to the hashing methods being unable to discover rich semantic information and the training strategy having difficulty optimizing the discrete binary codes). In this paper, we propose a novel image hashing method, termed as \textbf{\underline{A}}symmetric \textbf{\underline{D}}eep \textbf{\underline{S}}emantic \textbf{\underline{Q}}uantization (\textbf{ADSQ}). \textbf{ADSQ} is implemented using three stream frameworks, which consist of one \emph{LabelNet} and two \emph{ImgNets}. The \emph{LabelNet} leverages the power of three fully-connected layers, which are used to capture rich semantic information between image pairs. For the two \emph{ImgNets}, they each adopt the same convolutional neural network structure, but with different weights (i.e., asymmetric convolutional neural networks). The two \emph{ImgNets} are used to generate discriminative compact hash codes. Specifically, the function of the \emph{LabelNet} is to capture rich semantic information that is used to guide the two \emph{ImgNets} in minimizing the gap between the real-continuous features and the discrete binary codes. Furthermore, \textbf{ADSQ} can utilize the most critical semantic information to guide the feature learning process and consider the consistency of the common semantic space and Hamming space. Experimental results on three benchmarks (i.e., CIFAR-10, NUS-WIDE, and ImageNet) demonstrate that the proposed \textbf{ADSQ} can outperforms current state-of-the-art methods.

Real-Time Image Semantic Retrieval Based on VQ

Color Image Retrieval Utilizing Extended Fast Vq Codeword Search Technique And Vector Composition-Based Feedback

Image Retrieval Based on Wavelets Vector Quantization

An image semantic retrieval system design and realization

Deep Visual-Semantic Quantization For Efficient Image Retrieval

Video retrieval using VQ-based global motion features

Fast Search In Large-Scale Image Database Using Vector Quantization

Study and Application of Semantic-Based Image Retrieval

Two-stage high resolution remote sensing image retrieval combining semantic and visual features

On-chip real-time feature extraction using semantic annotations for object recognition

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

Research On Graphical Annotation And Retrieval Of Image Semantic

A new image retrieval system supporting query by semantics and example

Image Retrieval Based on Visual Semantics and RSSVM

LibVQ: A Toolkit for Optimizing Vector Quantization and Efficient Neural Retrieval.

Image Retrieval Model Providing Semantics and Visual-Features-based Query for Users

Asymmetric Deep Semantic Quantization for Image Retrieval

Image Annotation with Multiple Quantization.

A Semantic-Based Image Retrieval System: VisEngine

High Accurate and Efficient Image Retrieval Method Using Semantics for Visual Indoor Positioning.

Deep quantization network with visual-semantic alignment for zero-shot image retrieval