Abstract:Automatic image annotation plays a significant role in image understanding, retrieval, classification, and indexing. Today, it is becoming increasingly important in order to annotate large-scale social media images from content-sharing websites and social networks. These social images are usually annotated by user-provided low-quality tags. The topic model is considered as a promising method to describe these weak-labeling images by learning latent representations of training samples. The recent annotation methods based on topic models have two shortcomings. First, they are difficult to scale to a large-scale image dataset. Second, they can not be used to online image repository because of continuous addition of new images and new tags. In this paper, we propose a novel annotation method based on topic model, namely local learning-based probabilistic latent semantic analysis (LL-PLSA), to solve the above problems. The key idea is to train a weighted topic model for a given test image on its semantic neighborhood consisting of a fixed number of semantically and visually similar images. This method can scale to a large-scale image database, as training samples involved in modeling are a few nearest neighbors rather than the entire database. Moreover, this proposed topic model, online customized for the test image, naturally addresses the issue of continuous addition of new images and new tags in a database. Extensive experiments on three benchmark datasets demonstrate that the proposed method significantly outperforms the state-of-the-art especially in terms of overall metrics.

A two-stage hybrid probabilistic topic model for refining image annotation

Incorporating Probabilistic Knowledge into Topic Models.

Image Annotation and Refinement with Markov Chain Model of Visual Keywords and the Semantics

A Probabilistic Semantic Model for Image Annotation and Multi-Modal Image Retrieval

A Two-Phase Generation Model for Automatic Image Annotation

Improve Image Annotation by Using Markov Model

A Weighted Topic Model Learned from Local Semantic Space for Automatic Image Annotation

The Image Annotation Refinement in Embedding Feature Space Based on Mutual Information

Improve Image Annotation by Combining Multiple Models

Automatic Image Annotation Based on Topic-Based Smoothing

Semi-supervised topic modeling for image annotation.

A Two-Level Model for Automatic Image Annotation

Image Annotation Combining Feedback Log and Mixture Probabilistic Model

Topic models for image annotation and text illustration

Automatic Image Annotation Based on Improved Relevance Model

A New Algorithm For Image Annotation Based On Markov Model

Image Annotation Refinement Using Semantic Similarity Correlation

Modeling Loosely Annotated Images Using Both Given and Imagined Annotations

Automatic Image Annotation Refinement Based on Keyword Co-Occurrence and WordNet

A Feature-Word-topic Model for Image Annotation and Retrieval

Semi-Supervised Learning Model Based Efficient Image Annotation