Abstract:Driven by the rapid development of Internet and digital technologies, we have witnessed the explosive growth of Web images in recent years. Seeing that labels can reflect the semantic contents of the images, automatic image annotation, which can further facilitate the procedure of image semantic indexing, retrieval, and other image management tasks, has become one of the most crucial research directions in multimedia. Most of the existing annotation methods, heavily rely on well-labeled training data (expensive to collect) and/or single view of visual features (insufficient representative power). In this paper, inspired by the promising advance of feature engineering (e.g., CNN feature and scale-invariant feature transform feature) and inexhaustible image data (associated with noisy and incomplete labels) on the Web, we propose an effective and robust scheme, termed robust multi-view semi-supervised learning (RMSL), for facilitating image annotation task. Specifically, we exploit both labeled images and unlabeled images to uncover the intrinsic data structural information. Meanwhile, to comprehensively describe an individual datum, we take advantage of the correlated and complemental information derived from multiple facets of image data (i.e., multiple views or features). We devise a robust pairwise constraint on outcomes of different views to achieve annotation consistency. Furthermore, we integrate a robust classifier learning component via $\ell _{2,p}$ loss, which can provide effective noise identification power during the learning process. Finally, we devise an efficient iterative algorithm to solve the optimization problem in RMSL. We conduct comprehensive experiments on three different data sets, and the results illustrate that our proposed approach is promising for automatic image annotation.

Stable Multi-Label Boosting for Image Annotation with Structural Feature Selection.

Multi-label Boosting for Image Annotation by Structural Grouping Sparsity.

Image Annotation by Input&#x2013;Output Structural Grouping Sparsity

Incorporating Prior Knowledge Into Multi-Label Boosting For Cross-Modal Image Annotation And Retrieval

Multi-label feature selection based on stable label relevance and label-specific features

Automatic image annotation by incorporating feature hierarchy and boosting to scale up SVM classifiers.

Multi-label image annotation based on multi-model

Multi-Modal Multi-Scale Deep Learning for Large-Scale Image Annotation

Integrating hierarchical feature selection and classifier training for multi-label image annotation.

FeaBoost: Joint Feature and Label Refinement for Semantic Segmentation.

Multi-view multi-label learning for image annotation

Structured Semantic Transfer for Multi-Label Recognition with Partial Labels

Multi-Label Hyperspectral Classification with Discriminative Features.

Robust Web Image Annotation Via Exploring Multi-Facet and Structural Knowledge

Multi-Modal Multi-Label Semantic Indexing of Images Using Unlabeled Data

Group-preserving Label-Specific Feature Selection for Multi-Label Learning

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

Effective Multi-Modal Multi-Label Learning for Automatic Image Annotation.

Multi-Modal Multi-Label Semantic Indexing Of Images Based On Hybrid Ensemble Learning

Image annotation by semi-supervised cross-domain learning with group sparsity

Label-Aware Attention Network with Multi-Scale Boosting for Medical Image Segmentation