Abstract:Significant progress has been made in instance image retrieval based on deep feature aggregation. However, existing approaches are limited by two issues: 1) The inability of deep features to localize target objects generates inaccurate feature descriptions and 2) using short vector feature representations provides unsatisfactory retrieval performance. To address these issues, we propose the compact deep semantic correlation descriptor (DSCD) approach, which has three main highlights: (1) Unlike manual labeling approaches, we propose a channel semantic correlation learning method to localize target objects. This method can learn semantic correlation information between channels from an auxiliary dataset and use this information as a priori knowledge to locate target objects well. (2) We propose a hierarchical attention mechanism to integrate multi-level features within target regions. It utilizes object and focus attention modules to capture global and local features, and constructs channel attention coefficients to enhance channels containing important target features. (3) We propose a general, yet efficient dimensionality reduction method named adaptive PCA-whitening to improve short vector feature retrieval performance. This method can dynamically fuse the feature vectors of different dimensions via adaptive coefficients, yielding a more compact and robust representation. Extensive experiments on six benchmark datasets show that our method achieves better retrieval performance compared to existing state-of-the-art unsupervised methods. Compared with the next-best unsupervised methods, the mAP scores of our method (dim = 128) are 11.2 %, 6.1 %, 9.3 %, 8.3 %, 14.3 %, and 22.1 % higher on the Oxford5K, Paris6K, Oxford105K, Paris106K, ROxford, and RParis datasets, respectively.

A novel image retrieval approach based on semantic affinity

A novel method of image retrieval based on combination of semantic and visual features

Image Retrieval Based on Fuzzy Semantic Relevance Matrix

A Novel Semantics-Based Image Retrieval Method Using Similarity Measure of Multi-Level Semantics

Image Retrieval Based on Various Semantic Feature Fusion

A Novel Approach Supporting Multi-image Queries in Image Retrieval

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

A Novel Semantic-Based Image Retrieval Method

A Novel Image Retrieval Method Based on Multi-Features Fusion

A Novel Image Retrieval Algorithm Based on K-Neighbor Semi-Supervised Affinity Propagation Algorithm

Image retrieval using compact deep semantic correlation descriptors

A Novel Interactive Image Retrieval Method Based on LSH and SVM

A Semantic Image Retrieval Approach Between Visual Features and Medical Concepts

A novel multi-feature fusion and sparse coding-based framework for image retrieval

Semantic Association Based Image Retrieve and Image Index

A Retrieval Mechanism for Complex Similarity Queries in Image Databases

Image annotation based on feature fusion and semantic similarity.

A New Algorithm of Image Retrieval Based on Multiple-Feature and FSIM

A survey of content-based image retrieval with high-level semantics

Improving Context-Based Medical Image Retrieval by Incorporating Semantic-Based Retrieval.

A Novel Optimization-Based Approach for Content-Based Image Retrieval.