Abstract:<p>Hashing methods have been widely applied to approximate nearest neighbor search in large-scale image retrieval due to its fast search speed and efficient storage space. In practice, most images are with multiple category-aware objects, i.e., multi-label images. This paper focuses on hash code learning for multi-label image retrieval. Most existing hashing methods directly extract one patch such as a downsized crop from each image as a training example, which ignores the multi-label characteristic of images and leads to suboptimal representations for multi-label images. Some researches have proved that each multi-label image follows a multi-instance assumption, where each image is represented as a bag of category-aware proposals (instances). However, existing multiple-instance learning methods use predefined statistical functions with limited learning capability to construct bag features, and they are designed for classification or pairwise-similarity preserving. Thus, directly applying existing multiple-instance learning methods into deep hashing framework still leads to suboptimal hash codes for retrieval. In this paper, we pose hashing learning for multi-label image retrieval as a problem of multiple-instance ranking learning. To solve this problem, we present an end-to-end deep hashing framework, referred to as Deep Multiple-Instance Ranking based Hashing (DMIRH). In DMIRH, we design a category-aware bag feature construction module, which jointly assigns the learned instances into categories and aggregates the selected instance features into a bag feature representation that can capture the multi-label information of each image. In addition, we propose a novel learning objective, which consists of an Inner Product distance based quantization loss to control the hash quality and a listwise ranking loss to preserve the ranking relationships. Experimental results on public benchmarks show the superiority of DMIRH over several state-of-the-art hashing methods.</p>

Hypergraph-based multi-example ranking with sparse representation for transductive learning image retrieval

Semantic Image Retrieval Based on Multiple-Instance Learning

Multi-Query Parallel Field Ranking for image retrieval.

Online Learning to Rank for Content-Based Image Retrieval.

Fast Content-Based Image Retrieval Based on Equal-Average K-Nearest-Neighbor Search Schemes

A comprehensive study on learning to rank for content-based image retrieval

Learning to Combine Ad-hoc Ranking Functions for Image Retrieval

Online Multi-Core Ranking Model for Image Retrieval

Large-scale Image Retrieval with Sparse Embedded Hashing

Leveraging semantic segmentation for hybrid image retrieval methods

Multi-Grained Attention Network with Mutual Exclusion for Composed Query-Based Image Retrieval

Feature-Based Similarity Retrieval in Content-Based Image Retrieval

An Adaptive Query Prototype Modeling Method for Image Search Reranking

Generalized Manifold-Ranking-Based Image Retrieval

Efficient Image Retrieval Using Hierarchical K-Means Clustering

Image retrieval using compact deep semantic correlation descriptors

Collaborative Image Relevance Learning for Visual Re-Ranking.

Cross-Modal Attention Preservation with Self-Contrastive Learning for Composed Query-Based Image Retrieval

Mobile image retrieval using multi-photos as query

Indicative Image Retrieval: Turning Blackbox Learning into Grey

Multiple-Instance ranking based deep hashing for multi-Label image retrieval