Abstract:Deep learning techniques can be used to describe image content, which is a good way to reduce the semantic gap between low-level and high-level features. However, convolutional neural networks (CNNs) exhibit texture bias and largely ignore global object shape. This does not conform to human perception and can fail to gain the advantages of both low-level features and deep features. To address this problem, in this work, the main focus was shifted from using simple deep features to the use of sublimated deep features, which incorporate global object shape and color features. Along these lines, in this work, a novel image retrieval method named the sublimated deep feature histogram (SDFH) was proposed. The main highlights are: 1) An effect orientation feature was introduced, namely, orientation-selective feature, to mimic the orientation-selection mechanism. This provides a good representation of global object shape and reduces the side-effects of texture bias. 2) A new concept was developed, namely color perceptual feature, to address the shortcoming of deep features—that they discard color features. This includes color cues in the deep features and provides a more discriminating representation. 3) The orientation selective and color perception mechanisms were effectively mimicked to provide a compact yet efficient representation, and propose an effective transfer learning method called gain whitening learning. By carrying out comparative experiments, it was demonstrated that sublimated deep features can provide highly competitive retrieval performance (in terms of mean average precision) using a pre-trained CNN model applied to well-known benchmark datasets. Our results provide new insights into image retrieval based on the mechanisms of the primary visual cortex (V1). Furthermore, the method is more in line with human perception than other methods.

Deep Feature Aggregation and Image Re-Ranking with Heat Diffusion for Image Retrieval

Deep Hashing with Top Similarity Preserving for Image Retrieval

Aggregating Hierarchical Binary Activations for Image Retrieval

Image retrieval based on aggregated deep features weighted by regional significance and channel sensitivity

Deep Aggregation of Regional Convolutional Activations for Content Based Image Retrieval

Democratic Diffusion Aggregation for Image Retrieval

Query-Adaptive Image Search Re-Ranking Using Deep Convolutional Neural Network Feature

Image retrieval by aggregating deep orientation structure features

Unsupervised Semantic-Based Convolutional Features Aggregation for Image Retrieval

Deep Progressive Hashing for Image Retrieval

Deep-seated features histogram: A novel image retrieval method

Deep Progressive Feature Aggregation Network for High Dynamic Range Imaging

Adaptive Co-weighting Deep Convolutional Features For Object Retrieval

Cascaded Feature Augmentation With Diffusion For Image Retrieval

Query-Adaptive Image Retrieval by Deep-Weighted Hashing

Exploiting sublimated deep features for image retrieval

Content‐based image retrieval for super‐resolutioned images using feature fusion: Deep learning and hand crafted

Deep Transfer Hashing for Image Retrieval.

Deep Residual Net Based Compact Feature Representation for Image Retrieval.

Deep Spatial Attention Hashing Network for Image Retrieval.

Unsupervised Part-based Weighting Aggregation of Deep Convolutional Features for Image Retrieval