Abstract:Hashing and quantization have greatly succeeded by benefiting from deep learning for large-scale image retrieval. Recently, deep product quantization methods have attracted wide attention. However, representation capability of codewords needs to be further improved. Moreover, since the number of codewords in the codebook depends on experience, representation capability of codewords is usually imbalanced, which leads to redundancy or insufficiency of codewords and reduces retrieval performance. Therefore, in this paper, we propose a novel deep product quantization method, named Entropy Optimized deep Weighted Product Quantization (EOWPQ), which not only encodes samples into the weighted codewords in a new flexible manner but also balances the codeword assignment, improving while balancing representation capability of codewords. Specifically, we encode samples using the linear weighted sum of codewords instead of a single codeword as traditionally. Meanwhile, we establish the linear relationship between the weighted codewords and semantic labels, which effectively maintains semantic information of codewords. Moreover, in order to balance the codeword assignment, that is, avoiding some codewords representing most samples or some codewords representing very few samples, we maximize the entropy of the coding probability distribution and obtain the optimal coding probability distribution of samples by utilizing optimal transport theory, which achieves the optimal assignment of codewords and balances representation capability of codewords. The experimental results on three benchmark datasets show that EOWPQ can achieve better retrieval performance and also show the improvement of representation capability of codewords and the balance of codeword assignment.

Orthonormal Product Quantization Network for Scalable Face Image Retrieval

Unsupervised Deep Quantization for Object Instance Search.

Heterogeneous Hashing Network for Face Retrieval Across Image and Video Domains

Beyond Product Quantization: Deep Progressive Quantization for Image Retrieval.

Scalable Image Retrieval by Sparse Product Quantization

Deep Product Quantization Module for Efficient Image Retrieval

Hessian-based Mixed-Precision Quantization with Transition Aware Training for Neural Networks

Scalable Face Image Retrieval Integrating Multi-Feature Quantization And Constrained Reference Re-Ranking

Pse: Mixed Quantization Framework of Neural Networks for Efficient Deployment

Progressive Similarity Preservation Learning for Deep Scalable Product Quantization

Large-similarity image similarity retrieval method and system based on deep product quantization

Unleashing the Full Potential of Product Quantization for Large-Scale Image Retrieval.

Entropy-Optimized Deep Weighted Product Quantization for Image Retrieval

Deep Quantization Network for Efficient Image Retrieval

Spherical Centralized Quantization for Fast Image Retrieval

Deep Fourier Ranking Quantization for Semi-Supervised Image Retrieval

Towards Codebook-Free Deep Probabilistic Quantization for Image Retrieval.

HiHPQ: Hierarchical Hyperbolic Product Quantization for Unsupervised Image Retrieval

Collective Deep Quantization for Efficient Cross-Modal Retrieval.

Deep Visual-Semantic Quantization For Efficient Image Retrieval

Differentiable Optimized Product Quantization and Beyond