Abstract:Many machine learning methods such as generative model and discriminative model have been applied to image automatic image annotation.However,due to the semantic gap,the imbalanced training data,and the multi-label characteristic of image annotation,the annotation performance still calls for improvement.In this paper,an image annotation method is proposed which augments the classical generative model with the proposed discriminative hyperplane tree.Based on the high visual generative probability training images(neighborhood) of the unlabeled image,the local hyperplane classification tree is adaptively established.The relevant training image set is obtained through top-down hierarchical classification procedure by exploiting the discriminative information at each level.The joint probability between the unlabeled image and the words is estimated based on the obtained relevant local training set under the proposed framework.This method combines the advantages of both generative model and the discriminative models.From the aspect of generative model:by exploiting the discriminative information of the cluster in the discriminative hyperplane tree,a local generative set is progressively refined,and therefore,improves accuracy.From the aspect of discriminative model:the multiple label assignment can be naturally implement by estimating the joint probability,which reduces the limitation of discriminative model induced by the imbalanced and overlapping training set.The experiments on the ECCV2002 benchmark show that the method outperforms state-of-the-art generative model-based annotation method MBRM and discriminative model based ASVM-MIL with F1 measure improving by 14% and 13% respectively.

Hybrid Generative/Discriminative Learning for Automatic Image Annotation

Hybrid generative/discriminative learning for automatic image annotation

Effective Automatic Image Annotation Via Integrated Discriminative and Generative Models

An Hmm-Svm-Based Automatic Image Annotation Approach

Automatic image annotation via local multi-label classification

A Multi-Modal Hashing Learning Framework for Automatic Image Annotation

Effective Image Auto-Annotation Via Discriminative Hyperplane Tree Based Generative Model

A hybrid hierarchical framework for automatic image annotation

Multi-Modal Multi-Label Semantic Indexing Of Images Based On Hybrid Ensemble Learning

Hierarchical Image Automatic Annotation Based on Discriminative and Generative Models

TSVM-HMM: Transductive SVM Based Hidden Markov Model for Automatic Image Annotation

A Two-Level Model for Automatic Image Annotation

Multi-Modal Multi-Label Semantic Indexing of Images Using Unlabeled Data

A Revisit of Generative Model for Automatic Image Annotation Using Markov Random Fields

A Two-Phase Generation Model for Automatic Image Annotation

Automatic Image Region Annotation Through Segmentation Based Visual Semantic Analysis and Discriminative Classification

Integrating visual classifier ensemble with term extraction for Automatic Image Annotation

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Ensemble of Multiple Descriptors for Automatic Image Annotation

Automatic image annotation with cooperation of concept-specific and universal visual vocabularies

Automatic Image Annotation Combining Svms and Knn Algorithm