Abstract:Image search can be viewed as a problem of large-scale approximate nearest neighbor (ANN) search in image feature space. Hash ranking methods have been widely used for ANN search because of their two benefits: less memory usage and high search efficiency. Generally, the hash ranking methods face two problems: binary encoding and binary code ranking. This paper focuses on the latter. In existing work, the ranking of binary hash codes is usually implemented based on Hamming distance or asymmetric distance. Hamming distance easily leads to confusing ranking when different candidate points share the same Hamming distance to the query point. Therefore, recent work prefers the asymmetric distance to Hamming distance. When computing asymmetric distance, it is necessary to give reasonable query-independent values. These values are usually approximated by average values of sample candidate points in existing methods. However, when the distribution of candidate points is not uniform, average values are meaningless, leading to wrong ranking results. To address this problem, we propose two kinds of weighted asymmetric distance algorithms, namely, the Otsu threshold based algorithm (WoRank) and the score calculation based algorithm (WsRank) in this paper. The processes of these two proposed algorithms are similar, consisting of two steps. In the first step, we compute the query-independent values on each bit in accordance with corresponding distribution of candidate points to reduce the approximation error. In the second step, we compute bitwise weights in consideration of each bit's discriminative power to further improve the retrieval accuracy. The differences between WoRank and WsRank are the computation methods of query-independent values and bitwise weights. To evaluate the proposed algorithms, we conduct a large number of experiments on four well-known datasets, namely, SIFT, CIFAR-10, MNIST, and NUS-WIDE. The results show that the proposed algorithms can achieve up to 22% performance gains over Hamming distance based ranking and 13% over the existing asymmetric distance based ranking. We also find WoRank is suitable for feature dataset (SIFT), while WsRank is suitable for image datasets.

Semantic Image Retrieval with Feature Space Rankings.

Supervised Coarse-to-Fine Semantic Hashing for Cross-Media Retrieval.

Supervised Ranking Hash For Semantic Similarity Search

A New Ranking Based Semantic Hashing Method for Deep Image Retrieval

Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval.

Image Retrieval via Balanced and Maximum Variance Deep Hashing.

Semantic Hashing with Image Subspace Learning

Deep Semantic Ranking Based Hashing for Multi-Label Image Retrieval

Cross-Modal Hashing Through Ranking Subspace Learning

Rank Subspace Learning for Compact Hash Codes.

Discretely Coding Semantic Rank Orders for Supervised Image Hashing.

Rank-embedded Hashing for Large-scale Image Retrieval

Latent Semantic Minimal Hashing for Image Retrieval.

Probability Ordinal-Preserving Semantic Hashing for Large-Scale Image Retrieval

Integration of Semantic and Visual Hashing for Image Retrieval

Robust Discrete Spectral Hashing for Large-Scale Image Semantic Indexing

Linear Subspace Ranking Hashing for Cross-Modal Retrieval

Weakly-supervised Semantic Guided Hashing for Social Image Retrieval

Hash Ranking with Weighted Asymmetric Distance for Image Search.

Image retrieval with query-adaptive hashing

Image Retrieval with Well-Separated Semantic Hash Centers.