Abstract:Deep learning techniques can be used to describe image content, which is a good way to reduce the semantic gap between low-level and high-level features. However, convolutional neural networks (CNNs) exhibit texture bias and largely ignore global object shape. This does not conform to human perception and can fail to gain the advantages of both low-level features and deep features. To address this problem, in this work, the main focus was shifted from using simple deep features to the use of sublimated deep features, which incorporate global object shape and color features. Along these lines, in this work, a novel image retrieval method named the sublimated deep feature histogram (SDFH) was proposed. The main highlights are: 1) An effect orientation feature was introduced, namely, orientation-selective feature, to mimic the orientation-selection mechanism. This provides a good representation of global object shape and reduces the side-effects of texture bias. 2) A new concept was developed, namely color perceptual feature, to address the shortcoming of deep features—that they discard color features. This includes color cues in the deep features and provides a more discriminating representation. 3) The orientation selective and color perception mechanisms were effectively mimicked to provide a compact yet efficient representation, and propose an effective transfer learning method called gain whitening learning. By carrying out comparative experiments, it was demonstrated that sublimated deep features can provide highly competitive retrieval performance (in terms of mean average precision) using a pre-trained CNN model applied to well-known benchmark datasets. Our results provide new insights into image retrieval based on the mechanisms of the primary visual cortex (V1). Furthermore, the method is more in line with human perception than other methods.

Image retrieval based on deep Tamura feature descriptor

Deep Hashing with Top Similarity Preserving for Image Retrieval

Enhanced Micro-structure Descriptor based Image Retrieval.

Exploiting sublimated deep features for image retrieval

M-DFNet

Deep-seated features histogram: A novel image retrieval method

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Image Retrieval Method Based Texture Watermarks

A New Texture Feature Extraction Method for Image Retrieval

Image retrieval using compact deep semantic correlation descriptors

Image retrieval based on effective feature extraction and diffusion process

Remote Sensing Image Retrieval with Deep Features Encoding of Inception V4 and Largevis Dimensionality Reduction

Deep Residual Net Based Compact Feature Representation for Image Retrieval.

A Feature Learning Approach For Image Retrieval

Selective Convolutional Descriptor Aggregation for Fine-Grained Image Retrieval

Image retrieval by aggregating deep orientation structure features

Image retrieval using underlying importance feature histogram

Retrieval Oriented Deep Feature Learning With Complementary Supervision Mining.

Learning Enriched Feature Descriptor for Image Matching and Visual Measurement

Differential Geometric Retrieval of Deep Features

Image retrieval based on aggregated deep features weighted by regional significance and channel sensitivity