Abstract:The increasing demand for effective retrieval from image datasets has been driven by the rapid growth of digital images. Image retrieval is a method for creating a structured database based on searching for similar images to a user's query image. Effective image representation and extraction of distinctive features are among the challenges faced by image retrieval systems. The proposed approach utilizes a triplet loss function based on binary cross-entropy to train a Siamese network, allowing for deep metric learning and creating a discriminative feature space with maximum discrimination between classes and minimum intra-class distance. In this approach, a pre-trained neural network is serialized with Siamese network. Initially, image features are extracted using a pre-trained convolutional neural network. Then, a Siamese network is trained to create a discriminative feature space using deep metric learning. Learning in this method is controlled by a triplet loss function based on binary cross-entropy with anchor, positive, and negative samples. The transformation from the initial feature space to the discriminative feature space is achieved through deep metric learning in the Siamese network. The proposed approach proves to effective in discriminating features of diverse classes in the dataset. Visualization of the feature space is also demonstrated using the t-SNE statistical technique. Furthermore, the explainability of the proposed approach is presented by examining the Shapley value. The proposed approach was examined on the Corel10K, Caltech101, and Caltech256 datasets. The best reported results with the precision metric were 0.988 for the Corel10K dataset and 0.951 and 0.902 for the Caltech101 and Caltech256 datasets, respectively. Experimental results show that the proposed approach effectively improves the retrieval results of similar samples to the query image creating discrimination in the feature vectors, even with dimensionality reduction.

A Feature Learning Approach For Image Retrieval

Learning Feature Embedding with Strong Neural Activations for Fine-Grained Retrieval

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Retrieval Oriented Deep Feature Learning With Complementary Supervision Mining.

A Fast Image Retrieval Method with Convolutional Neural Networks

Image Retrieval Using Fused Deep Convolutional Features

Feature Learning For SAR Images Using Convolutional Neural Network.

Exploiting the Complementary Strengths of Multi-Layer CNN Features for Image Retrieval.

Learning Discriminative Features for Fine-grained Image Retrieval

Learning Discriminative Features for Image Retrieval.

Deep Learning For Image Retrieval: What Works And What Doesn'T

Feature Extraction with Triplet Convolutional Neural Network for Content-Based Image Retrieval

A multi-level descriptor using ultra-deep feature for image retrieval

Enhancing Remote Sensing Image Retrieval with Triplet Deep Metric Learning Network

Research on image feature extraction and retrieval algorithms based on convolutional neural network

Convolutional neural codes for image retrieval

Feature extraction and image retrieval based on AlexNet

Exploiting sublimated deep features for image retrieval

Multi-level Image Representation for Large-Scale Image-Based Instance Retrieval.

Enhancing image retrieval through entropy-based deep metric learning

Deep Hash Learning for Efficient Image Retrieval