Abstract:Images are complex multimedia data that contain rich semantic information. Currently, most of image annotation algorithms are only annotating the object semantics of images. There are still many challenges on high-level semantic image annotation. The major issues are the lack of effective modeling method for the high-level semantics of images and the lack of efficient dynamic update mechanism for the training set. To address these issues, we propose a high-level semantic annotation method based on hot Internet topics in this paper. There are two independent sub tasks in our method: dynamic update of the training set based on hot Internet topics and search-based image annotation. In the first sub task, we propose to model the abstract semantics of images based on three relationships: image–to–image similarity relationship, topic–to–topic co-occurrence relationship, and image–to–topic relevance relationship. Through the complex graph clustering, the hot Internet topics are extracted for images with consistent visual and semantic contents. Then the dynamic update mechanism will update the original training set with the new topics and images. It avoids the huge computing cost in traditional update methods and does not need to re-calculate the whole mapping relationship between the semantic concepts and visual features. In the second sub task, given a query image, it first searches for similar candidates in the annotated training set via visual features. Then the hypergraph modeling and spectral clustering are exploited to filter out the images with irrelevant semantics. The keywords will be extracted for annotation from the remaining images according to an annotation probability. Extensive experiments have been conducted and the results demonstrate that our algorithm could achieve better annotation performance than the state-of-the-art algorithms. And the update mechanism could extend the training set efficiently so that the coverage of the semantics in the training set wouldn’t be obsolete.

Semantic Annotation of Image Based on Information Bottleneck Method

Semantic Annotations of Image Based on Mutual Information and Constrained Clustering

Image Semantic Annotating Method Based on Region Features Relevancy

A Semantic Context Model For Automatic Image Annotation

Image Annotations Based on Semi-supervised Clustering with Semantic Soft Constraints.

A New Approach for Automatic Image Annotation Based on Semantic Clustering and Graph Algorithm

A Novel Automatic Image Annotation Method Based on Co-occurrence Keywords

High-level Semantic Image Annotation Based on Hot Internet Topics.

Image Segmentation Based on Information Bottleneck Algorithm

A Semi-Supervised Color Image Segmentation Method

Semantic Image Segmentation Using Low-Level Features and Contextual Cues.

Supervised Semantic Image Annotation Using Region Relevance

Region-based supervised annotation for semantic image retrieval

Unsupervised object category discovery via information bottleneck method.

A stratification-based approach to accurate and fast image annotation

Image Annotation Algorithm Based on Semantic Similarity and Multi-features.

Image Semantic Description and Automatic Semantic Annotation

A Method Combined SML and Ontology for Image Semantic Auto-annotation

A Weighted Feature Based Automatic Image Annotation

Image Region Annotation Based on Segmentation and Semantic Correlation Analysis

Automatic image annotation by using concept-sensitive salient objects for image content representation.