Abstract:Automatic image annotation (AIA) is very important to image retrieval and image understanding. Two key issues in AIA are explored in detail in this paper, i.e., structured visual feature selection and the implementation of hierarchical correlated structures among multiple tags to boost the performance of image annotation. This paper simultaneously introduces an input and output structural grouping sparsity into a regularized regression model for image annotation. For input high-dimensional heterogeneous features such as color, texture, and shape, different kinds (groups) of features have different intrinsic discriminative power for the recognition of certain concepts. The proposed structured feature selection by structural grouping sparsity can be used not only to select group-of-features but also to conduct within-group selection. Hierarchical correlations among output labels are well represented by a tree structure, and therefore, the proposed tree-structured grouping sparsity can be used to boost the performance of multitag image annotation. In order to efficiently solve the proposed regression model, we relax the solving process as a framework of the bilayer regression model for multilabel boosting by the selection of heterogeneous features with structural grouping sparsity (Bi-MtBGS). The first-layer regression is to select the discriminative features for each label. The aim of the second-layer regression is to refine the feature selection model learned from the first layer, which can be taken as a multilabel boosting process. Extensive experiments on public benchmark image data sets and real-world image data sets demonstrate that the proposed approach has better performance of multitag image annotation and leads to a quite interpretable model for image understanding.

Image annotation by semi-supervised cross-domain learning with group sparsity

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

Semi-supervised learning for image annotation based on conditional random fields

Image Annotation by the Multiple Kernel Learning with Group Sparsity Effect

Local Weight Coupled Network: Multi-Modal Unequal Semi-Supervised Domain Adaptation.

Web Image Annotation Via Subspace-Sparsity Collaborated Feature Selection

Automatic image annotation via local multi-label classification

3D Medical Image Segmentation with Sparse Annotation via Cross-Teaching between 3D and 2D Networks

Image Annotation by Input&#x2013;Output Structural Grouping Sparsity

Multi-label Boosting for Image Annotation by Structural Grouping Sparsity.

Semi-automatic Dynamic Auxiliary-Tag-aided Image Annotation

Exploiting the entire feature space with sparsity for automatic image annotation.

Tag Localization with Spatial Correlations and Joint Group Sparsity

Semi-Supervised Graph Based Embedding with Non-Convex Sparse Coding Techniques

Spatial and Semantic Consistency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images

Towards Multi-Semantic Image Annotation with Graph Regularized Exclusive Group Lasso

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Active Learning with Label Correlation Exploration for Multi-Label Image Classification

Multi-Modal Multi-Label Semantic Indexing of Images Using Unlabeled Data

Image Annotations Based on Semi-supervised Clustering with Semantic Soft Constraints.

Weakly Semi-Supervised Deep Learning for Multi-Label Image Annotation