Abstract:Images are complex multimedia data that contain rich semantic information. Currently, most of image annotation algorithms are only annotating the object semantics of images. There are still many challenges on high-level semantic image annotation. The major issues are the lack of effective modeling method for the high-level semantics of images and the lack of efficient dynamic update mechanism for the training set. To address these issues, we propose a high-level semantic annotation method based on hot Internet topics in this paper. There are two independent sub tasks in our method: dynamic update of the training set based on hot Internet topics and search-based image annotation. In the first sub task, we propose to model the abstract semantics of images based on three relationships: image–to–image similarity relationship, topic–to–topic co-occurrence relationship, and image–to–topic relevance relationship. Through the complex graph clustering, the hot Internet topics are extracted for images with consistent visual and semantic contents. Then the dynamic update mechanism will update the original training set with the new topics and images. It avoids the huge computing cost in traditional update methods and does not need to re-calculate the whole mapping relationship between the semantic concepts and visual features. In the second sub task, given a query image, it first searches for similar candidates in the annotated training set via visual features. Then the hypergraph modeling and spectral clustering are exploited to filter out the images with irrelevant semantics. The keywords will be extracted for annotation from the remaining images according to an annotation probability. Extensive experiments have been conducted and the results demonstrate that our algorithm could achieve better annotation performance than the state-of-the-art algorithms. And the update mechanism could extend the training set efficiently so that the coverage of the semantics in the training set wouldn’t be obsolete.

A New Approach for Automatic Image Annotation Based on Semantic Clustering and Graph Algorithm

Image Annotations Based on Semi-supervised Clustering with Semantic Soft Constraints.

A Novel Automatic Image Annotation Method Based on Co-occurrence Keywords

Image Semantic Annotating Method Based on Region Features Relevancy

Semantic Annotations of Image Based on Mutual Information and Constrained Clustering

Image Annotation Based on Semantic Clustering and Relevance Feedback

Semantic Annotation of Image Based on Information Bottleneck Method

A Semi-Supervised Color Image Segmentation Method

A Novel Approach for Annotation-based Image Retrieval Using Deep Architecture.

Image Annotation Using Semantic Clusters from Flickr

Automatic Image Annotation Based on Particle Swarm Optimization and Support Vector Clustering

A Novel Data-driven Image Annotation Method

Automatic image annotation by using concept-sensitive salient objects for image content representation.

An interactive semi-supervised approach for automatic image annotation

Automatic image annotation using semantic relevance

Image Annotation Algorithm Based on Semantic Similarity and Multi-features.

Automatic image annotation based on salient regions

Image Annotation Based on Semantic Structure and Graph Learning

High-level Semantic Image Annotation Based on Hot Internet Topics.

Automatic semantic annotation of images based on Web data.

Support Vector Description of Clusters for Content-Based Image Annotation