Abstract:ABSTRACTAnnotating large-scale image corpus requires huge amount of human efforts and is thus generally unaffordable, which directly motivates recent development of semi-supervised or active annotation methods. In this paper we revisit this notoriously challenging problem and develop a novel multi-label propagation scheme, whereby both the efficacy and accuracy of large-scale image annotation are further enhanced. Our investigation starts from a survey of previous graph propagation based annotation approaches, wherein we analyze their main drawbacks when scaling up to large-scale datasets and handling multi-label setting. Our proposed scheme outperforms the state-of-the-art algorithms by making the following contributions. 1) Unlike previous approaches that propagate over individual label independently, our proposed large-scale multi-label propagation (LSMP) scheme encodes the tag information of an image as a unit label confidence vector, which naturally imposes inter-label constraints and manipulates labels interactively. It then utilizes the probabilistic Kullback-Leibler divergence for problem formulation on multi-label propagation. 2) We perform the multi-label propagation on the so-called hashing-based L1-graph, which is efficiently derived with Locality Sensitive Hashing approach followed by sparse L1-graph construction within the individual hashing buckets. 3) An efficient and convergency provable iterative procedure is presented for problem optimization. Extensive experiments on NUS-WIDE dataset (both lite version with 56k images and full version with 270k images) well validate the effectiveness and scalability of the proposed approach.

Integrating distance metric learning into label propagation model for multi-label image annotation

Collaborative Similarity Metric Learning for Semantic Image Annotation and Retrieval.

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Multi-label image annotation based on multi-model

Efficient large-scale image annotation by probabilistic collaborative multi-label propagation.

Effective Multi-Modal Multi-Label Learning for Automatic Image Annotation.

Distance Metric Learning from Uncertain Side Information with Application to Automated Photo Tagging

Automatic image annotation via local multi-label classification

Image Annotation By Learning Label-Specific Distance Metrics

Multi-view Based Multi-Label Propagation for Image Annotation

Correlative multi-label multi-instance image annotation

Multi-label learning by Image-to-Class distance for scene classification and image annotation

Efficient Region-Aware Large Graph Construction Towards Scalable Multi-Label Propagation

Reconstruction Regularized Deep Metric Learning for Multi-label Image Classification

Structured Max-Margin Learning for Multi-Label Image Annotation

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING

Learning Multi-Task Local Metrics for Image Annotation

Utilization of Rotation-Invariant Uniform LBP Histogram Distribution and Statistics of Connected Regions in Automatic Image Annotation Based on Multi-Label Learning.

Incorporating Prior Knowledge Into Multi-Label Boosting For Cross-Modal Image Annotation And Retrieval

A Multi Label Learning Method Using Affinity Propagation and Support Vector Machine

Exploiting Inconsistency Problem in Multi-label Classification Via Metric Learning