Abstract:<p>Hashing methods have been widely applied to approximate nearest neighbor search in large-scale image retrieval due to its fast search speed and efficient storage space. In practice, most images are with multiple category-aware objects, i.e., multi-label images. This paper focuses on hash code learning for multi-label image retrieval. Most existing hashing methods directly extract one patch such as a downsized crop from each image as a training example, which ignores the multi-label characteristic of images and leads to suboptimal representations for multi-label images. Some researches have proved that each multi-label image follows a multi-instance assumption, where each image is represented as a bag of category-aware proposals (instances). However, existing multiple-instance learning methods use predefined statistical functions with limited learning capability to construct bag features, and they are designed for classification or pairwise-similarity preserving. Thus, directly applying existing multiple-instance learning methods into deep hashing framework still leads to suboptimal hash codes for retrieval. In this paper, we pose hashing learning for multi-label image retrieval as a problem of multiple-instance ranking learning. To solve this problem, we present an end-to-end deep hashing framework, referred to as Deep Multiple-Instance Ranking based Hashing (DMIRH). In DMIRH, we design a category-aware bag feature construction module, which jointly assigns the learned instances into categories and aggregates the selected instance features into a bag feature representation that can capture the multi-label information of each image. In addition, we propose a novel learning objective, which consists of an Inner Product distance based quantization loss to control the hash quality and a listwise ranking loss to preserve the ranking relationships. Experimental results on public benchmarks show the superiority of DMIRH over several state-of-the-art hashing methods.</p>

Large-scale image retrieval based on multi-feature and multi-kernel hashing learning

Multiple Feature Kernel Hashing for Large-Scale Visual Search.

Kernelized Iterative Hashing for Image Retrieval

Image Retrieval via Balanced and Maximum Variance Deep Hashing.

Scalable Multimedia Retrieval By Deep Learning Hashing With Relative Similarity Learning

Multiple Hierarchical Deep Hashing for Large Scale Image Retrieval

Deep Multiple Instance Hashing for Fast Multi-Object Image Search

Multi-level Supervised Hashing with Deep Features for Efficient Image Retrieval

Multiple Code Hashing for Efficient Image Retrieval

Unsupervised Deep Hashing with Adaptive Feature Learning for Image Retrieval

Multiple-Instance ranking based deep hashing for multi-Label image retrieval

Multiple Feature Hashing Learning For Large-Scale Remote Sensing Image Retrieval

Deep Multi-Negative Supervised Hashing for Large-Scale Image Retrieval

Deep Multi-Label Hashing For Large-Scale Visual Search Based On Semantic Graph

Deep Multi-View Enhancement Hashing for Image Retrieval.

Compact kernel hashing with multiple features.

Deep Multiple Instance Hashing for Object-based Image Retrieval.

Deep-Like Hashing-in-Hash for Visual Retrieval: an Embarrassingly Simple Method.

Incremental Image Retrieval Method Based on Feature Perception and Deep Hashing

Deep Hashing Based Fusing Index Method for Large-Scale Image Retrieval

Deep Multiscale Fusion Hashing for Cross-Modal Retrieval