Abstract:Hashing and quantization have greatly succeeded by benefiting from deep learning for large-scale image retrieval. Recently, deep product quantization methods have attracted wide attention. However, representation capability of codewords needs to be further improved. Moreover, since the number of codewords in the codebook depends on experience, representation capability of codewords is usually imbalanced, which leads to redundancy or insufficiency of codewords and reduces retrieval performance. Therefore, in this paper, we propose a novel deep product quantization method, named Entropy Optimized deep Weighted Product Quantization (EOWPQ), which not only encodes samples into the weighted codewords in a new flexible manner but also balances the codeword assignment, improving while balancing representation capability of codewords. Specifically, we encode samples using the linear weighted sum of codewords instead of a single codeword as traditionally. Meanwhile, we establish the linear relationship between the weighted codewords and semantic labels, which effectively maintains semantic information of codewords. Moreover, in order to balance the codeword assignment, that is, avoiding some codewords representing most samples or some codewords representing very few samples, we maximize the entropy of the coding probability distribution and obtain the optimal coding probability distribution of samples by utilizing optimal transport theory, which achieves the optimal assignment of codewords and balances representation capability of codewords. The experimental results on three benchmark datasets show that EOWPQ can achieve better retrieval performance and also show the improvement of representation capability of codewords and the balance of codeword assignment.

Channel-Wise Part-Based Weighting Aggregation for Image Retrieval

Unsupervised Part-based Weighting Aggregation of Deep Convolutional Features for Image Retrieval

Exploring Geometric Information in CNN for Image Retrieval.

Image retrieval based on aggregated deep features weighted by regional significance and channel sensitivity

Beyond Sum and Weighted Aggregation

Adaptive Co-weighting Deep Convolutional Features For Object Retrieval

Unifying Sum and Weighted Aggregations for Efficient Yet Effective Image Representation Computation

Unsupervised Semantic-Based Convolutional Features Aggregation for Image Retrieval

Probability Weighted Compact Feature for Domain Adaptive Retrieval

Spatially aware feature selection and weighting for object retrieval

Co-weighting semantic convolutional features for object retrieval.

Location Soft-Aggregation-Based Band Weighting for Hyperspectral Image Classification

Entropy-Optimized Deep Weighted Product Quantization for Image Retrieval

Lossless Image Compression Based on DPCM-IWPT

Adaptively Weighted Graph Fusion for Image Retrieval.

Underwater Image Enhancement via Weighted Wavelet Visual Perception Fusion

BoW Pooling: A Plug-and-Play Unit for Feature Aggregation of Point Clouds

Selective Convolutional Features based Generalized-mean Pooling for Fine-grained Image Retrieval

Weighted Component Hashing of Binary Aggregated Descriptors for Fast Visual Search.

Deep Image Retrieval: Indicator and Gram Matrix Weighting for Aggregated Convolutional Features

Query-Adaptive Image Retrieval by Deep-Weighted Hashing