Abstract:Learning effective feature representations and similarity measures are crucial to the retrieval performance of a content-based image retrieval (CBIR) system. Despite extensive research efforts for decades, it remains one of the most challenging open problems that considerably hinders the successes of real-world CBIR systems. The key challenge has been attributed to the well-known ``semantic gap'' issue that exists between low-level image pixels captured by machines and high-level semantic concepts perceived by human. Among various techniques, machine learning has been actively investigated as a possible direction to bridge the semantic gap in the long term. Inspired by recent successes of deep learning techniques for computer vision and other applications, in this paper, we attempt to address an open problem: if deep learning is a hope for bridging the semantic gap in CBIR and how much improvements in CBIR tasks can be achieved by exploring the state-of-the-art deep learning techniques for learning feature representations and similarity measures. Specifically, we investigate a framework of deep learning with application to CBIR tasks with an extensive set of empirical studies by examining a state-of-the-art deep learning method (Convolutional Neural Networks) for CBIR tasks under varied settings. From our empirical studies, we find some encouraging results and summarize some important insights for future research.

Semantics Modeling Based Image Retrieval System Using Neural Networks

Learning A Semantic Space from User'S Relevance Feedback for Image Retrieval

Semantic Image Retrieval Based on Multiple-Instance Learning

Domain-Specific Modeling and Semantic Alignment for Image-Based 3d Model Retrieval

An image semantic retrieval system design and realization

A Neural Network Approach for Bridging the Semantic Gap in Texture Image Retrieval

Learning Semantic Concepts from Visual Data Using Neural Networks.

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

A Hybird Image Retrieval System with User'S Relevance Feedback Using Neurocomputing

The Methods of Semantics Processing in Content-Based Image Retrieval

Image Retrieval Model Providing Semantics and Visual-Features-based Query for Users

ImageSaker : A Semantic-based Image Retrieval System Refining with Concept Model

Study and Application of Semantic-Based Image Retrieval

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

A Novel Semantics-Based Image Retrieval Method Using Similarity Measure of Multi-Level Semantics

An Image Retrieval Method Based on Self-learning Dynamic Semantic Network

Image Retrieval Based on Fuzzy Semantic Relevance Matrix

Image Retrieval Based on Fuzzy Color Semantics.

Multilateral Semantic Relations Modeling for Image Text Retrieval

A Novel Semantic-Based Image Retrieval Method

Semantics-Based Art Image Retrieval Using Linguistic Variable