Abstract:Most existing methods on weakly supervised image annotation rely on jointly unsupervised feature representation, the components of which are not directly correlated with specific labels. In practical cases, however, there is a big gap between the training and the testing data, say the label combination of the testing data is not always consistent with that of the training. To bridge the gap, this paper presents a semantic label embedding dictionary representation that not only achieves the discriminative feature representation for each label in the image, but also mines the semantic relevance between co-occurrence labels for context information. More specifically, to enhance the discriminative representation of labels, the training data is first divided into a set of overlapped groups by graph shift based on the exclusive label graph. Afterward, given a group of exclusive labels, we try to learn multiple label-specific dictionaries to explicitly decorrelate the feature representation of each label. A joint optimization approach is proposed according to the Fisher discrimination criterion for seeking its solution. Then, to discover the context information hidden in the co-occurrence labels, we explore the semantic relationship between visual words in dictionaries and labels in a multitask learning way with respect to the reconstruction coefficients of the training data. In the annotation stage, with the discriminative dictionaries and exclusive label groups as well as a group sparsity constraint, the reconstruction coefficients of a test image can be easily obtained. Finally, we introduce a label propagation scheme to compute the score of each label for the test image based on its reconstruction coefficients. Experimental results on three challenging data sets demonstrate that our proposed method leads to significant performance gains over existing methods.

AN EM-BASED UNSUPERVISED REGIONS ANNOTATION ALGORITHM FOR MULTI-LABELS OF IMAGE

An Empirical Study of Automatic Image Annotation Through Multi-Instance Multi-Label Learning

Automatic image annotation based on salient regions

Image Semantic Annotating Method Based on Region Features Relevancy

Region-based supervised annotation for semantic image retrieval

Correlative multi-label multi-instance image annotation

Supervised Semantic Image Annotation Using Region Relevance

Transductive Multi-Instance Multi-Label Learning Algorithm with Application to Automatic Image Annotation

Multi-label image annotation based on multi-model

Effective Multi-Modal Multi-Label Learning for Automatic Image Annotation.

Automatic image annotation via local multi-label classification

SLED: Semantic Label Embedding Dictionary Representation for Multi-label Image Annotation

A Multi-feature Fusion Method for Automatic Multi-label Image Annotation with Weighted Histogram Integral and Closure Regions Counting

Automatic image annotation by an iterative approach: incorporating keyword correlations and region matching

Image Region Annotation Based on Segmentation and Semantic Correlation Analysis

Multi-scale Salient Region and Relevant Visual Keywords Based Model for Automatic Image Annotation

Ensemble of Multiple Descriptors for Automatic Image Annotation

Automatic tag-to-region assignment via multiple instance learning

Automatic Region-Based Image Annotation Using An Improved Multiple-Instance Learning Algorithm

Automatic Image Annotation Based on Wordnet and Hierarchical Ensembles

Multi-semantic Scene Classification Based on Region of Interest