Abstract:Most existing methods on weakly supervised image annotation rely on jointly unsupervised feature representation, the components of which are not directly correlated with specific labels. In practical cases, however, there is a big gap between the training and the testing data, say the label combination of the testing data is not always consistent with that of the training. To bridge the gap, this paper presents a semantic label embedding dictionary representation that not only achieves the discriminative feature representation for each label in the image, but also mines the semantic relevance between co-occurrence labels for context information. More specifically, to enhance the discriminative representation of labels, the training data is first divided into a set of overlapped groups by graph shift based on the exclusive label graph. Afterward, given a group of exclusive labels, we try to learn multiple label-specific dictionaries to explicitly decorrelate the feature representation of each label. A joint optimization approach is proposed according to the Fisher discrimination criterion for seeking its solution. Then, to discover the context information hidden in the co-occurrence labels, we explore the semantic relationship between visual words in dictionaries and labels in a multitask learning way with respect to the reconstruction coefficients of the training data. In the annotation stage, with the discriminative dictionaries and exclusive label groups as well as a group sparsity constraint, the reconstruction coefficients of a test image can be easily obtained. Finally, we introduce a label propagation scheme to compute the score of each label for the test image based on its reconstruction coefficients. Experimental results on three challenging data sets demonstrate that our proposed method leads to significant performance gains over existing methods.

Weakly Semi-Supervised Deep Learning for Multi-Label Image Annotation

Weakly semi-supervised deep learning for multi-label image annotation

Learning From Semi-Supervised Weak-Label Data

Automatic Image Annotation with Weakly Labeled Dataset

SLED: Semantic Label Embedding Dictionary Representation for Multi-label Image Annotation

Weakly Supervised Multi-Label Learning Via Label Enhancement

Weakly supervised learning for multi-class medical image segmentation via feature decomposition

Global-Guided Weakly-Supervised Learning for Multi-Label Image Classification

Learning Safe Multi-Label Prediction for Weakly Labeled Data

Multi-Evidence Filtering and Fusion for Multi-Label Classification, Object Detection and Semantic Segmentation Based on Weakly Supervised Learning

Semi-supervised Semantic Segmentation via Strong-Weak Dual-Branch Network

Semi-supervised dual low-rank feature mapping for multi-label image annotation

Learning from Weak and Noisy Labels for Semantic Segmentation.

Multi-View Semi-Supervised Learning For Web Image Annotation

Learning from weak and noisy labels for semantic segmentation

Enhancing Weakly Supervised Semantic Segmentation with Multi-label Contrastive Learning and LLM Features Guidance

Weak Labeled Multi-Label Active Learning for Image Classification

Deep Learning for Multilabel Remote Sensing Image Annotation with Dual-Level Semantic Concepts

Effective Multi-Modal Multi-Label Learning for Automatic Image Annotation.

Multi-label image annotation based on multi-model

Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentation