Abstract:ABSTRACTAnnotating large-scale image corpus requires huge amount of human efforts and is thus generally unaffordable, which directly motivates recent development of semi-supervised or active annotation methods. In this paper we revisit this notoriously challenging problem and develop a novel multi-label propagation scheme, whereby both the efficacy and accuracy of large-scale image annotation are further enhanced. Our investigation starts from a survey of previous graph propagation based annotation approaches, wherein we analyze their main drawbacks when scaling up to large-scale datasets and handling multi-label setting. Our proposed scheme outperforms the state-of-the-art algorithms by making the following contributions. 1) Unlike previous approaches that propagate over individual label independently, our proposed large-scale multi-label propagation (LSMP) scheme encodes the tag information of an image as a unit label confidence vector, which naturally imposes inter-label constraints and manipulates labels interactively. It then utilizes the probabilistic Kullback-Leibler divergence for problem formulation on multi-label propagation. 2) We perform the multi-label propagation on the so-called hashing-based L1-graph, which is efficiently derived with Locality Sensitive Hashing approach followed by sparse L1-graph construction within the individual hashing buckets. 3) An efficient and convergency provable iterative procedure is presented for problem optimization. Extensive experiments on NUS-WIDE dataset (both lite version with 56k images and full version with 270k images) well validate the effectiveness and scalability of the proposed approach.

A Novel Model for Multi-label Image Annotation

Multi-label image annotation based on multi-model

A Novel Image Annotation Model Based on Content Representation with Multi-Layer Segmentation.

Multi-label Image Annotation Based on Convolutional Neural Network

The image annotation algorithm using convolutional features from intermediate layer of deep learning

A Semantic Context Model For Automatic Image Annotation

Effective Multi-Modal Multi-Label Learning for Automatic Image Annotation.

CNN-feature based automatic image annotation method

Exploit Bounding Box Annotations for Multi-Label Object Recognition

A Novel Method of Automatic Image Annotation

A novel image tag completion method based on convolutional neural network

A multi-label image classification method combining multi-stage image semantic information and label relevance

Improve Image Annotation by Combining Multiple Models

Summary of the Researches on Multi -Label Image Annotation

Multi-view Based Multi-Label Propagation for Image Annotation

A Multi-feature Fusion Method for Automatic Multi-label Image Annotation with Weighted Histogram Integral and Closure Regions Counting

A Multi-task Learning Approach for Image Captioning.

Correlative multi-label multi-instance image annotation

Efficient large-scale image annotation by probabilistic collaborative multi-label propagation.

Content and Context-Based Multi-Label Image Annotation.

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification