Abstract:Multi-level annotation of images is a promising solution to enable semantic image retrieval by using various keywords at different semantic levels. In this paper, we propose a multi-level approach to interpret and annotate the semantics of natural images by using both the dominant image components and the relevant semantic image concepts. In contrast to the well-known image-based and region-based approaches, we use the concept-sensitive salient objects as the dominant image components to achieve automatic image annotation at the content level. By using the concept-sensitive salient objects for image content representation and feature extraction, a novel image classification technique is developed to achieve automatic image annotation at the concept level. To detect the concept-sensitive salient objects automatically, a set of detection functions are learned from the labeled image regions by using support vector machine (SVM) classifiers with an automatic scheme for searching the optimal model parameters. To generate the semantic image concepts, the finite mixture models are used to approximate the class distributions of the relevant concept-sensitive salient objects. An adaptive EM algorithm has been proposed to determine the optimal model structure and model parameters simultaneously. In addition, a large number of unlabeled samples have been integrated with a limited number of labeled samples to achieve more effective classifier training and knowledge discovery. We have also demonstrated that our algorithms are very effective to enable multi-level interpretation and annotation of natural images.

An approach of multi-level semantics abstraction

Semantic Image Retrieval Based on Multiple-Instance Learning

Research on high-level semantic image retrieval

Research On Methodology Of Image Semantic Understanding

Semantic Image Segmentation Based on Spatial Context Relations

AN APPROACH TO SEMANTICS-BASED IMAGE RETRIEVAL AND BROWSING

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

A Summary of Semantics-based Image Retrieval

Semantic Communication Approach for Multi-Task Image Transmission

Statistical Modeling and Conceptualization of Natural Images

Image Retrieval Based on Fuzzy Semantic Relevance Matrix

Thesaurus-aided Approach for Image Browsing and Retrieval

A survey of content-based image retrieval with high-level semantics

A Systematic Approach to Semantics-Based Image Retrieval and Organization Using Thesaurus1

An Overview of Semantics Processing in Content-Based 3D Model Retrieval

Exploiting Multi-Context Analysis in Semantic Image Classification

Learning Semantics for Image Annotation

Automatic image annotation by using concept-sensitive salient objects for image content representation.

Semantic Classification and Annotation of Images

An Image Retrieval Method Based on High-level Image Semantic Information

A new image retrieval system supporting query by semantics and example