Abstract:Significant progress has been made in instance image retrieval based on deep feature aggregation. However, existing approaches are limited by two issues: 1) The inability of deep features to localize target objects generates inaccurate feature descriptions and 2) using short vector feature representations provides unsatisfactory retrieval performance. To address these issues, we propose the compact deep semantic correlation descriptor (DSCD) approach, which has three main highlights: (1) Unlike manual labeling approaches, we propose a channel semantic correlation learning method to localize target objects. This method can learn semantic correlation information between channels from an auxiliary dataset and use this information as a priori knowledge to locate target objects well. (2) We propose a hierarchical attention mechanism to integrate multi-level features within target regions. It utilizes object and focus attention modules to capture global and local features, and constructs channel attention coefficients to enhance channels containing important target features. (3) We propose a general, yet efficient dimensionality reduction method named adaptive PCA-whitening to improve short vector feature retrieval performance. This method can dynamically fuse the feature vectors of different dimensions via adaptive coefficients, yielding a more compact and robust representation. Extensive experiments on six benchmark datasets show that our method achieves better retrieval performance compared to existing state-of-the-art unsupervised methods. Compared with the next-best unsupervised methods, the mAP scores of our method (dim = 128) are 11.2 %, 6.1 %, 9.3 %, 8.3 %, 14.3 %, and 22.1 % higher on the Oxford5K, Paris6K, Oxford105K, Paris106K, ROxford, and RParis datasets, respectively.

Scalable Object Retrieval with Compact Image Representation from Generic Object Regions

Feature Representation for 3D Object Retrieval Based on Unconstrained Multi-View

Fast Object Retrieval Using Direct Spatial Matching

Object retrieval using configurations of salient regions

Image retrieval using compact deep semantic correlation descriptors

Object-Centric Open-Vocabulary Image-Retrieval with Aggregated Features

Weighted Transformable Spatial Pyramid And Scalable Query For Object Retrieval

Coarse-to-Fine: Learning Compact Discriminative Representation for Single-Stage Image Retrieval

Search by Detection: Object-Level Feature for Image Retrieval

Learning Token-Based Representation for Image Retrieval

Large scale partially duplicated web image retrieval.

Compact and Effective Representations for Sketch-based Image Retrieval

Mobile Visual Search Compression with Grassmann Manifold Embedding

Object Level Deep Feature Pooling for Compact Image Representation

An Efficient and Effective Region-Based Image Retrieval Framework

Scalable local feature matching without visual codebook training

Compact Projection: Simple and Efficient Near Neighbor Search with Practical Memory Requirements

Fast, Compact and Highly Scalable Visual Place Recognition through Sequence-based Matching of Overloaded Representations

Constraint Based Region Matching for Image Retrieval

Deep Residual Net Based Compact Feature Representation for Image Retrieval.

Scalable Face Image Retrieval Integrating Multi-Feature Quantization And Constrained Reference Re-Ranking