Abstract:<p>Hashing methods have been widely applied to approximate nearest neighbor search in large-scale image retrieval due to its fast search speed and efficient storage space. In practice, most images are with multiple category-aware objects, i.e., multi-label images. This paper focuses on hash code learning for multi-label image retrieval. Most existing hashing methods directly extract one patch such as a downsized crop from each image as a training example, which ignores the multi-label characteristic of images and leads to suboptimal representations for multi-label images. Some researches have proved that each multi-label image follows a multi-instance assumption, where each image is represented as a bag of category-aware proposals (instances). However, existing multiple-instance learning methods use predefined statistical functions with limited learning capability to construct bag features, and they are designed for classification or pairwise-similarity preserving. Thus, directly applying existing multiple-instance learning methods into deep hashing framework still leads to suboptimal hash codes for retrieval. In this paper, we pose hashing learning for multi-label image retrieval as a problem of multiple-instance ranking learning. To solve this problem, we present an end-to-end deep hashing framework, referred to as Deep Multiple-Instance Ranking based Hashing (DMIRH). In DMIRH, we design a category-aware bag feature construction module, which jointly assigns the learned instances into categories and aggregates the selected instance features into a bag feature representation that can capture the multi-label information of each image. In addition, we propose a novel learning objective, which consists of an Inner Product distance based quantization loss to control the hash quality and a listwise ranking loss to preserve the ranking relationships. Experimental results on public benchmarks show the superiority of DMIRH over several state-of-the-art hashing methods.</p>

Unsupervised Deep Hashing with Dynamic Pseudo-Multi-Labels for Image Retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Supervised Hashing With Pseudo Labels For Scalable Multimedia Retrieval

Unsupervised Deep Hashing with Adaptive Feature Learning for Image Retrieval

Deep Unsupervised Self-Evolutionary Hashing for Image Retrieval

Unsupervised Deep K-Means Hashing for Efficient Image Retrieval and Clustering

Multiple-Instance ranking based deep hashing for multi-Label image retrieval

Unsupervised Deep Triplet Hashing for Image Retrieval

Pseudo-label driven deep hashing for unsupervised cross-modal retrieval

Improved Deep Unsupervised Hashing with Fine-grained Semantic Similarity Mining for Multi-Label Image Retrieval

Sparse graph based self-supervised hashing for scalable image retrieval

Scalable Multimedia Retrieval By Deep Learning Hashing With Relative Similarity Learning

Deep Supervised Hashing by Classification for Image Retrieval

SSDH: Semi-Supervised Deep Hashing for Large Scale Image Retrieval

Unsupervised Discriminative Hashing

Ipdh: An Improved Pairwise-Based Deep Hashing Method For Large-Scale Image Retrieval

Deep Self-Adaptive Hashing for Image Retrieval

Deep Unsupervised Weighted Hashing for Remote Sensing Image Retrieval

Robust Deep Supervised Hashing for Image Retrieval

Deep noise mitigation and semantic reconstruction hashing for unsupervised cross-modal retrieval

Feature Learning Based Deep Supervised Hashing with Pairwise Labels