Abstract:With the rapidly growing number of images over the Internet, efficient scalable semantic image retrieval becomes increasingly important. This paper presents a novel approach for semantic image retrieval by combining Convolutional Neural Network (CNN) and Markov Random Field (MRF). As a key step, image concept detection, that is, automatically recognizing multiple semantic concepts in an unlabeled image, plays an important role in semantic image retrieval. Unlike previous work that uses single-concept classifiers one by one, we detect semantic multiconcept by using a multiconcept scene classifier. In other words, our approach takes multiple concepts as a holistic scene for multiconcept scene learning. Specifically, we first train a CNN as a concept classifier, which further includes two types of classifiers: a single-concept fully connected classifier that is best suited to single-concept detection and a multiconcept scene fully connected classifier that is good for holistic scene detection. Then we propose an MRF-based late fusion approach that is able to effectively learn the semantic correlation between the single-concept classifier and multiconcept scene classifier. Finally, the semantic correlation among the subconcepts of images is cought to further improve detection precision. In order to investigate the feasibility and effectiveness of our proposed approach, we conduct comprehensive experiments on two publicly available image databases. The results show that our proposed approach outperforms several state-of-the-art approaches.

Semantic Image Retrieval Based on Multiple-Instance Learning

Research on high-level semantic image retrieval

Learning A Semantic Space from User'S Relevance Feedback for Image Retrieval

Multi-spectral Remote Sensing Image Retrieval Based on Semantic Extraction

A Novel Semantics-Based Image Retrieval Method Using Similarity Measure of Multi-Level Semantics

An algorithm of object-based image retrieval using multiple instance learning

LSA Based Multi-Instance Learning Algorithm for Image Retrieval.

New Image Retrieval Method Based on Scene Semantics

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

Design and implementation of semantics-based image retrieval system

Multilateral Semantic Relations Modeling for Image Text Retrieval

An Image Retrieval Method Based on Self-learning Dynamic Semantic Network

Image Retrieval Based on Multi-instance Saliency Model

Image Retrieval Model Providing Semantics and Visual-Features-based Query for Users

A Method for Image Retrieval Based on Salient Points Feature Multiple-Instance Learning

Region-based Image Retrieval Using Semantic Mining

Multi-instance Learning Based on Instance Consistency for Image Retrieval

Multi-semantic Scene Classification Based on Region of Interest

ImageSaker : A Semantic-based Image Retrieval System Refining with Concept Model

Combining Convolutional Neural Network and Markov Random Field for Semantic Image Retrieval

AN APPROACH TO SEMANTICS-BASED IMAGE RETRIEVAL AND BROWSING