Abstract:Automatic image annotation concerns a process of automatically labeling image contents with a pre-defined set of keywords, which are regarded as descriptors of image high-level semantics, so as to enable semantic image retrieval via keywords. A serious problem in this task is the unsatisfactory annotation performance due to the semantic gap between the visual content and keywords. Targeting at this problem, we present a new approach that tries to incorporate lexical semantics into the image annotation process. In the phase of training, given a training set of images labeled with keywords, a basic visual vocabulary consisting of visual terms, extracted from the image to represent its content, and the associated keywords is generated at first, using K-means clustering combined with semantic constraints obtained from WordNet, then the statistical correlation between visual terms and keywords is modeled by a two-level hierarchical ensemble model composed of probabilistic SVM classifiers and a co-occurrence language model. In the phase of annotation, given an unlabeled image, the most likely associated keywords are predicted by the posterior probability of each keyword given each visual term at the first-level classifier ensemble, then the second-level language model is used to refine the annotation quality by word co-occurrence statistics derived from the annotated keywords in the training set of images. We carried out experiments on a medium-sized image collection from Corel Stock Photo CDs. The experimental results demonstrated that the annotation performance of this method outperforms some traditional annotation methods by about 7% in average precision, showing the feasibility and effectiveness of the proposed approach.

Automatic Image Annotation Based on Particle Swarm Optimization and Support Vector Clustering

Using Particle Swarm Optimization for Image Regions Annotation

Visual Attention Mechanism and Support Vector Machine Based Automatic Image Annotation.

Automatic Image Annotation Approach Based on Optimization of Classes Scores

Automatic image annotation based on salient regions

A New Approach for Automatic Image Annotation Based on Semantic Clustering and Graph Algorithm

Support vector description of clusters for image annotation

A PSO-SVM Approach for Image Retrieval and Clustering

A Survey on Automatic Image Annotation.

Automatic Image Annotation Combining Svms and Knn Algorithm

Semi-automatic Image Annotation Using Sparse Coding

Automatic image annotation by using concept-sensitive salient objects for image content representation.

Automatic Image Annotation Based-On Model Space

Fuzzy Classification of Remote Sensing Images Based on Particle Swarm Optimization

Particle Swarm Intelligence Classification Algorithm for Remote Sensing Images

Automatic Image Annotation Based on Wordnet and Hierarchical Ensembles

Application of improved PSO-SVM approach in image classification

Support Vector Description of Clusters for Content-Based Image Annotation

Image Annotations Based on Semi-supervised Clustering with Semantic Soft Constraints.

Automatic Image Annotation Via Category Labels

A web-based approach for image annotation