Abstract:Learning effective feature representations and similarity measures are crucial to the retrieval performance of a content-based image retrieval (CBIR) system. Despite extensive research efforts for decades, it remains one of the most challenging open problems that considerably hinders the successes of real-world CBIR systems. The key challenge has been attributed to the well-known ``semantic gap'' issue that exists between low-level image pixels captured by machines and high-level semantic concepts perceived by human. Among various techniques, machine learning has been actively investigated as a possible direction to bridge the semantic gap in the long term. Inspired by recent successes of deep learning techniques for computer vision and other applications, in this paper, we attempt to address an open problem: if deep learning is a hope for bridging the semantic gap in CBIR and how much improvements in CBIR tasks can be achieved by exploring the state-of-the-art deep learning techniques for learning feature representations and similarity measures. Specifically, we investigate a framework of deep learning with application to CBIR tasks with an extensive set of empirical studies by examining a state-of-the-art deep learning method (Convolutional Neural Networks) for CBIR tasks under varied settings. From our empirical studies, we find some encouraging results and summarize some important insights for future research.

3D Model Classification Using Salient Features for Content Representation

An Overview of Semantics Processing in Content-Based 3D Model Retrieval

Learning Exemplar-Represented Manifolds in Latent Space for Classification.

Domain-Specific Modeling and Semantic Alignment for Image-Based 3d Model Retrieval

Semantic-oriented 3D model classification and retrieval using Gaussian processes

3D model semantic classification and retrieval with Gaussian processes

3D Model Retrieval with Multi-Granular Semantics Based on Gaussian Process Classifier

3D Models Retrieval Method Based on Collaboration Semantic Annotation of Discrepant Features

3D Models Semantic Retrieval Method in Combination with Descriptive Text

Image-based 3D Model Retrieval Using Manifold Learning

Content based 3D model retrieval: A survey

Mapping Features to Semantic Space for 3D Model Retrieval

Application of Salient Corner Features in 3D Model Retrieval

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Geodesic Based Semi-supervised Multi-manifold Feature Extraction

A Unified Feature Representation and Learning Framework for 3D Shape

A New Sketch-Based 3D Model Retrieval Approach by Using Global and Local Features

Content-Based 3-D Model Retrieval: A Survey

An overview of content-based three-dimensional model retrieval methods

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and Recognition.