Abstract:Image retrieval with fine-grained categories is an extremely challenging task due to the high intraclass variance and low interclass variance. Most previous works have focused on localizing discriminative image regions in isolation, but have rarely exploited correlations across the different discriminative regions to alleviate intraclass differences. In addition, the intraclass compactness of embedding features is ensured by extra regularization terms that only exist during the training phase, which appear to generalize less well in the inference phase. Finally, the information granularity of the distance measure should distinguish subtle visual differences and the correlation between the embedding features and the quantized features should be maximized sufficiently. To address the above issues, we propose a logit variated product quantization method based on part interaction and metric learning with knowledge distillation for fine-grained image retrieval. Specifically, we introduce a causal context module into the deep navigator to generate discriminative regions and utilize a channelwise cross-part fusion transformer to model the part correlations while alleviating intraclass differences. Subsequently, we design a logit variation module based on a weighted sum scheme to further reduce the intraclass variance of the embedding features directly and enhance the learning power of the quantization model. Finally, we propose a novel product quantization loss based on metric learning and knowledge distillation to enhance the correlation between the embedding features and the quantized features and allow the quantization features to learn more knowledge from the embedding features. The experimental results on several fine-grained datasets demonstrate that the proposed method is superior to state-of-the-art fine-grained image retrieval methods.

Information Gain Product Quantization for Image Retrieval

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

Scalable Image Retrieval by Sparse Product Quantization

Deep Product Quantization Module for Efficient Image Retrieval

Mean-Removed Product Quantization for Large-scale Image Retrieval

PQBF: I/O-Efficient Approximate Nearest Neighbor Search by Product Quantization.

Mean-Removed Product Quantization for Approximate Nearest Neighbor Search.

Semi-supervised product quantization for approximate nearest neighbor search

Unleashing the Full Potential of Product Quantization for Large-Scale Image Retrieval.

Codebook-softened product quantization for high accuracy approximate nearest neighbor search

Dynamic programming based optimized product quantization for approximate nearest neighbor search.

Bilinear Optimized Product Quantization for Scalable Visual Content Analysis.

Multi-Pqtable For Approximate Nearest-Neighbor Search

Distribution Sensitive Product Quantization.

Beyond Product Quantization: Deep Progressive Quantization for Image Retrieval.

Online Variable Coding Length Product Quantization for Fast Nearest Neighbor Search in Mobile Retrieval.

Product quantization with dual codebooks for approximate nearest neighbor search

Entropy-Optimized Deep Weighted Product Quantization for Image Retrieval

Optimized High Order Product Quantization for Approximate Nearest Neighbors Search.

Spherical Centralized Quantization for Fast Image Retrieval

Logit Variated Product Quantization Based on Parts Interaction and Metric Learning with Knowledge Distillation for Fine-Grained Image Retrieval