Abstract:Most existing methods on weakly supervised image annotation rely on jointly unsupervised feature representation, the components of which are not directly correlated with specific labels. In practical cases, however, there is a big gap between the training and the testing data, say the label combination of the testing data is not always consistent with that of the training. To bridge the gap, this paper presents a semantic label embedding dictionary representation that not only achieves the discriminative feature representation for each label in the image, but also mines the semantic relevance between co-occurrence labels for context information. More specifically, to enhance the discriminative representation of labels, the training data is first divided into a set of overlapped groups by graph shift based on the exclusive label graph. Afterward, given a group of exclusive labels, we try to learn multiple label-specific dictionaries to explicitly decorrelate the feature representation of each label. A joint optimization approach is proposed according to the Fisher discrimination criterion for seeking its solution. Then, to discover the context information hidden in the co-occurrence labels, we explore the semantic relationship between visual words in dictionaries and labels in a multitask learning way with respect to the reconstruction coefficients of the training data. In the annotation stage, with the discriminative dictionaries and exclusive label groups as well as a group sparsity constraint, the reconstruction coefficients of a test image can be easily obtained. Finally, we introduce a label propagation scheme to compute the score of each label for the test image based on its reconstruction coefficients. Experimental results on three challenging data sets demonstrate that our proposed method leads to significant performance gains over existing methods.

A Multi-instance Multi-label Image Classification Method Based on Sparse Coding and Ensemble Learning

Image Classification Method by Combining Multi-features and Sparse Coding

Sparse Coding and Classifier Ensemble Based Multi-Instance Learning for Image Categorization

A Multi-Instance Multi-Label Scene Classification Method Based on Multi-Kernel Fusion

A Multi-Label Learning Algorithm Based on Sparse Representation

Image Classification Algorithm Based on Bag?Level Space Multiple Instance Learning with Sparse Representation

Image classification using label constrained sparse coding

Transductive Multi-Instance Multi-Label Learning Algorithm with Application to Automatic Image Annotation

Joint multi-label multi-instance learning for image classification

Deep Semantic Dictionary Learning for Multi-label Image Classification

Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

Learning Local Instance Constraint For Multi-Label Classification

Sparse Coding For Classification Via Discrimination Ensemble

A Novel Image Classification Method Based on Multi-layer Dictionary Learning

Multi-level Discriminative Dictionary Learning with Application to Large Scale Image Classification.

Feature Ensemble Learning Based on Sparse Autoencoders for Image Classification

A Deep Multi-Modal CNN for Multi-Instance Multi-Label Image Classification.

SLED: Semantic Label Embedding Dictionary Representation for Multi-label Image Annotation

Sparse Representation for Multi-Label Image Annotation

Correlative multi-label multi-instance image annotation

Image Representation Via Sub-Dictionary Based Sparse Coding