Abstract:Significant progress has been made in instance image retrieval based on deep feature aggregation. However, existing approaches are limited by two issues: 1) The inability of deep features to localize target objects generates inaccurate feature descriptions and 2) using short vector feature representations provides unsatisfactory retrieval performance. To address these issues, we propose the compact deep semantic correlation descriptor (DSCD) approach, which has three main highlights: (1) Unlike manual labeling approaches, we propose a channel semantic correlation learning method to localize target objects. This method can learn semantic correlation information between channels from an auxiliary dataset and use this information as a priori knowledge to locate target objects well. (2) We propose a hierarchical attention mechanism to integrate multi-level features within target regions. It utilizes object and focus attention modules to capture global and local features, and constructs channel attention coefficients to enhance channels containing important target features. (3) We propose a general, yet efficient dimensionality reduction method named adaptive PCA-whitening to improve short vector feature retrieval performance. This method can dynamically fuse the feature vectors of different dimensions via adaptive coefficients, yielding a more compact and robust representation. Extensive experiments on six benchmark datasets show that our method achieves better retrieval performance compared to existing state-of-the-art unsupervised methods. Compared with the next-best unsupervised methods, the mAP scores of our method (dim = 128) are 11.2 %, 6.1 %, 9.3 %, 8.3 %, 14.3 %, and 22.1 % higher on the Oxford5K, Paris6K, Oxford105K, Paris106K, ROxford, and RParis datasets, respectively.

Democratic Diffusion Aggregation for Image Retrieval

Fast Democratic Aggregation and Query Fusion for Image Search.

Aggregating Hierarchical Binary Activations for Image Retrieval

Exploring Geometric Information in CNN for Image Retrieval.

Image retrieval based on aggregated deep features weighted by regional significance and channel sensitivity

Aggregating Binary Local Descriptors for Image Retrieval

Cascaded Feature Augmentation With Diffusion For Image Retrieval

Weakly Supervised Soft-detection-based Aggregation Method for Image Retrieval.

Image retrieval based on effective feature extraction and diffusion process

Qdfa: Query-Dependent Feature Aggregation For Medical Image Retrieval

Adversarial Soft-detection-based Aggregation Network for Image Retrieval

Progressive Image Retrieval with Quality Guarantee under MapReduce Framework

Deep Aggregation of Regional Convolutional Activations for Content Based Image Retrieval

Scalable Multimedia Retrieval By Deep Learning Hashing With Relative Similarity Learning

Rank-Aware Graph Fusion With Contextual Dissimilarity Measurement For Image Retrieval

DCAFuse: Dual-Branch Diffusion-CNN Complementary Feature Aggregation Network for Multi-Modality Image Fusion

Efficient Image Retrieval Via Decoupling Diffusion into Online and Offline Processing.

Image retrieval by aggregating deep orientation structure features

Image retrieval using compact deep semantic correlation descriptors

Attention-based Dual Context Aggregation for Image Semantic Segmentation

Unsupervised Part-based Weighting Aggregation of Deep Convolutional Features for Image Retrieval