Abstract:Driven by the rapid development of Internet and digital technologies, we have witnessed the explosive growth of Web images in recent years. Seeing that labels can reflect the semantic contents of the images, automatic image annotation, which can further facilitate the procedure of image semantic indexing, retrieval, and other image management tasks, has become one of the most crucial research directions in multimedia. Most of the existing annotation methods, heavily rely on well-labeled training data (expensive to collect) and/or single view of visual features (insufficient representative power). In this paper, inspired by the promising advance of feature engineering (e.g., CNN feature and scale-invariant feature transform feature) and inexhaustible image data (associated with noisy and incomplete labels) on the Web, we propose an effective and robust scheme, termed robust multi-view semi-supervised learning (RMSL), for facilitating image annotation task. Specifically, we exploit both labeled images and unlabeled images to uncover the intrinsic data structural information. Meanwhile, to comprehensively describe an individual datum, we take advantage of the correlated and complemental information derived from multiple facets of image data (i.e., multiple views or features). We devise a robust pairwise constraint on outcomes of different views to achieve annotation consistency. Furthermore, we integrate a robust classifier learning component via $\ell _{2,p}$ loss, which can provide effective noise identification power during the learning process. Finally, we devise an efficient iterative algorithm to solve the optimization problem in RMSL. We conduct comprehensive experiments on three different data sets, and the results illustrate that our proposed approach is promising for automatic image annotation.

Multi-Modal Multi-Label Semantic Indexing of Images Using Unlabeled Data

Multi-Modal Multi-Label Semantic Indexing Of Images Based On Hybrid Ensemble Learning

Incorporating Prior Knowledge Into Multi-Label Boosting For Cross-Modal Image Annotation And Retrieval

A Multi-Modal Hashing Learning Framework for Automatic Image Annotation

Effective Multi-Modal Multi-Label Learning for Automatic Image Annotation.

Multi-label image annotation based on multi-model

Semi-supervised learning for image annotation based on conditional random fields

Automatic Image Annotation Based on Wordnet and Hierarchical Ensembles

Transductive Multi-Instance Multi-Label Learning Algorithm with Application to Automatic Image Annotation

An interactive semi-supervised approach for automatic image annotation

Multimodal Learning for Multi-Label Image Classification.

Multi-modal Multi-Concept-based Deep Neural Network for Automatic Image Annotation

Automatic image annotation via local multi-label classification

Automatic Image Annotation Based-On Model Space

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Robust Web Image Annotation Via Exploring Multi-Facet and Structural Knowledge

Semi-automatic Dynamic Auxiliary-Tag-aided Image Annotation

Adaptive Hypergraph Embedded Semi-Supervised Multi-Label Image Annotation

A Method Combined SML and Ontology for Image Semantic Auto-annotation

Multi-Modal Image Annotation with Multi-Instance Multi-Label LDA.

An Hmm-Svm-Based Automatic Image Annotation Approach