Abstract:Hashing and quantization have greatly succeeded by benefiting from deep learning for large-scale image retrieval. Recently, deep product quantization methods have attracted wide attention. However, representation capability of codewords needs to be further improved. Moreover, since the number of codewords in the codebook depends on experience, representation capability of codewords is usually imbalanced, which leads to redundancy or insufficiency of codewords and reduces retrieval performance. Therefore, in this paper, we propose a novel deep product quantization method, named Entropy Optimized deep Weighted Product Quantization (EOWPQ), which not only encodes samples into the weighted codewords in a new flexible manner but also balances the codeword assignment, improving while balancing representation capability of codewords. Specifically, we encode samples using the linear weighted sum of codewords instead of a single codeword as traditionally. Meanwhile, we establish the linear relationship between the weighted codewords and semantic labels, which effectively maintains semantic information of codewords. Moreover, in order to balance the codeword assignment, that is, avoiding some codewords representing most samples or some codewords representing very few samples, we maximize the entropy of the coding probability distribution and obtain the optimal coding probability distribution of samples by utilizing optimal transport theory, which achieves the optimal assignment of codewords and balances representation capability of codewords. The experimental results on three benchmark datasets show that EOWPQ can achieve better retrieval performance and also show the improvement of representation capability of codewords and the balance of codeword assignment.

Entropy-based Deep Product Quantization for Visual Search and Deep Feature Compression

Entropy Optimized Deep Feature Compression.

Entropy-Optimized Deep Weighted Product Quantization for Image Retrieval

Deep Product Quantization Module for Efficient Image Retrieval

Unsupervised Deep Quantization for Object Instance Search.

Beyond Product Quantization: Deep Progressive Quantization for Image Retrieval.

Progressive Similarity Preservation Learning for Deep Scalable Product Quantization

Towards Codebook-Free Deep Probabilistic Quantization for Image Retrieval.

Scalable Image Retrieval by Sparse Product Quantization

Deep Visual-Semantic Quantization For Efficient Image Retrieval

Comprehensive Comparisons of Uniform Quantization in Deep Image Compression

Differentiable Optimized Product Quantization and Beyond

Large-similarity image similarity retrieval method and system based on deep product quantization

Orthonormal Product Quantization Network for Scalable Face Image Retrieval

Deep Hashing using Entropy Regularised Product Quantisation Network

Webly Supervised Deep Attentive Quantization.

Unleashing the Full Potential of Product Quantization for Large-Scale Image Retrieval.

Deep Lossless Compression Algorithm Based on Arithmetic Coding for Power Data

HiHPQ: Hierarchical Hyperbolic Product Quantization for Unsupervised Image Retrieval

Shared Predictive Cross-Modal Deep Quantization.

Quantization and Entropy Coding Scheme for Dictionary Learning Based Image Compression.