Abstract:Hashing and quantization have greatly succeeded by benefiting from deep learning for large-scale image retrieval. Recently, deep product quantization methods have attracted wide attention. However, representation capability of codewords needs to be further improved. Moreover, since the number of codewords in the codebook depends on experience, representation capability of codewords is usually imbalanced, which leads to redundancy or insufficiency of codewords and reduces retrieval performance. Therefore, in this paper, we propose a novel deep product quantization method, named Entropy Optimized deep Weighted Product Quantization (EOWPQ), which not only encodes samples into the weighted codewords in a new flexible manner but also balances the codeword assignment, improving while balancing representation capability of codewords. Specifically, we encode samples using the linear weighted sum of codewords instead of a single codeword as traditionally. Meanwhile, we establish the linear relationship between the weighted codewords and semantic labels, which effectively maintains semantic information of codewords. Moreover, in order to balance the codeword assignment, that is, avoiding some codewords representing most samples or some codewords representing very few samples, we maximize the entropy of the coding probability distribution and obtain the optimal coding probability distribution of samples by utilizing optimal transport theory, which achieves the optimal assignment of codewords and balances representation capability of codewords. The experimental results on three benchmark datasets show that EOWPQ can achieve better retrieval performance and also show the improvement of representation capability of codewords and the balance of codeword assignment.

Deep Product Quantization Module for Efficient Image Retrieval

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

Beyond Product Quantization: Deep Progressive Quantization for Image Retrieval.

Unleashing the Full Potential of Product Quantization for Large-Scale Image Retrieval.

Scalable Image Retrieval by Sparse Product Quantization

Pse: Mixed Quantization Framework of Neural Networks for Efficient Deployment

Mean-Removed Product Quantization for Large-scale Image Retrieval

Differentiable Optimized Product Quantization and Beyond

Matching-oriented Embedding Quantization for Ad-hoc Retrieval.

Towards Codebook-Free Deep Probabilistic Quantization for Image Retrieval.

Unsupervised Deep Quantization for Object Instance Search.

Deep Quantization Network for Efficient Image Retrieval

Matching-oriented Product Quantization for Ad-hoc Retrieval

Hessian-based Mixed-Precision Quantization with Transition Aware Training for Neural Networks

Kernelized Product Quantization.

Mean-Removed Product Quantization for Approximate Nearest Neighbor Search.

Pyramid hybrid pooling quantization for efficient fine-grained image retrieval

Entropy-Optimized Deep Weighted Product Quantization for Image Retrieval

PHPQ: Pyramid Hybrid Pooling Quantization for Efficient Fine-Grained Image Retrieval

Codebook-softened product quantization for high accuracy approximate nearest neighbor search

Entropy-based Deep Product Quantization for Visual Search and Deep Feature Compression