Abstract:Automatic image annotation is a vital and challenging problem in pattern recognition and image understanding areas. The existing models directly extract visual features from segmented image regions. Since segmented image regions may still have multi-objects, the extractive visual features may not effectively describe corresponding regions. In addition, existing models did not consider the visual representations of corresponding keywords, which would lead to appearing plenty of irrelevant annotations in final annotation results, and these annotations did not relate to any part of images considering visual contents. In order to overcome the above problems, an image annotation model based on multi-scale salient region and relevant visual keywords is proposed. In this model, each image is segmented by using multi-scale grid segmentation method and the global contrast based method is used to extract the saliency maps from each image region. Visual features are extracted from each salient region. In addition, each keyword is divided into two categories: abstract words or non-abstract words. Visual seeds of each non-abstract word are established, and then a new method is proposed to extract visual keyword collections by using corresponding seeds. According to the traits of abstract words, an algorithm based on subtraction regions is proposed to extract visual seeds and corresponding visual keyword collections of each abstract word. Adaptive parameter method and a fast solution algorithm are proposed to determine the similarity thresholds of each keyword. Finally, multi-scale visual features and the combinations of the above methods are used to improve the annotation performance. Our model can improve the object descriptions of images and image regions. Experimental results verify the effectiveness of the proposed model.

Image Semantic Annotating Method Based on Region Features Relevancy

Research On Methodology Of Image Semantic Understanding

Semantic Image Segmentation Based on Spatial Context Relations

A Novel Automatic Image Annotation Method Based on Co-occurrence Keywords

A Semantic Annotation Algorithm Based on Image Regional Object Ontology

Supervised Semantic Image Annotation Using Region Relevance

Image Region Annotation Based on Segmentation and Semantic Correlation Analysis

Automatic image annotation using semantic relevance

Region-based supervised annotation for semantic image retrieval

Image Annotation Algorithm Based on Semantic Similarity and Multi-features.

Automatic Image Region Annotation Through Segmentation Based Visual Semantic Analysis and Discriminative Classification

Semantic Annotation of Image Based on Information Bottleneck Method

Automatic image annotation based on salient regions

Image Semantic Automatic Annotation by Relevance Feedback

Image Semantic Description and Automatic Semantic Annotation

A Semantic Distance Based Nearest Neighbor Method for Image Annotation.

A New Approach for Automatic Image Annotation Based on Semantic Clustering and Graph Algorithm

A Semantic Context Model For Automatic Image Annotation

A Method Combined SML and Ontology for Image Semantic Auto-annotation

Automatic Image Annotation Combining Semantic Neighbors and Deep Features

Multi-scale Salient Region and Relevant Visual Keywords Based Model for Automatic Image Annotation