Abstract:Learning effective feature representations and similarity measures are crucial to the retrieval performance of a content-based image retrieval (CBIR) system. Despite extensive research efforts for decades, it remains one of the most challenging open problems that considerably hinders the successes of real-world CBIR systems. The key challenge has been attributed to the well-known ``semantic gap'' issue that exists between low-level image pixels captured by machines and high-level semantic concepts perceived by human. Among various techniques, machine learning has been actively investigated as a possible direction to bridge the semantic gap in the long term. Inspired by recent successes of deep learning techniques for computer vision and other applications, in this paper, we attempt to address an open problem: if deep learning is a hope for bridging the semantic gap in CBIR and how much improvements in CBIR tasks can be achieved by exploring the state-of-the-art deep learning techniques for learning feature representations and similarity measures. Specifically, we investigate a framework of deep learning with application to CBIR tasks with an extensive set of empirical studies by examining a state-of-the-art deep learning method (Convolutional Neural Networks) for CBIR tasks under varied settings. From our empirical studies, we find some encouraging results and summarize some important insights for future research.

Content based Image Retrieval Using Combined Features

SIFT-Based Image Retrieval Combining the Distance Measure of Global Image and Sub-Image

Multistage and Multi-features Medical Image Retrieval System

Content-Based Image Retrieval By Dominant Color Feature

Research on Medical Image Retrieval System Based on DICOM Header Information and Content

Combining similarity measures in content-based image retrieval guided by mutual information

Design and Implementation on Content-based Web Image Retrieval System

Content-based Image Retrieval Using Optimal Feature Combination and Relevance Feedback

Image retrieval based on effective feature extraction and diffusion process

Combining Interest Points and Edges for Content-Based Image Retrieval

A CONTENT-BASED IMAGE RETRIEVAL SCHEME IN JPEG COMPRESSED DOMAIN

Digital image retrieval technology based on multi-feature

An Approach for Similar Image Retrieval Based on Multi-features Combination

Advancing Content-Based Image Retrieval by Exploiting Image Color and Region Features

Multi-Feature Fusion Image Retrieval Algorithm Based on Fuzzy Color

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Color Image Retrieval Utilizing Extended Fast Vq Codeword Search Technique And Vector Composition-Based Feedback

A Survey on Content-based Image Retrieval Techniques

An Image Retrieval Method Based on Color and Texture Features

Fast Content-Based Image Retrieval Based on Equal-Average K-Nearest-Neighbor Search Schemes

Content-Based Image And Video Indexing And Retrieval