Abstract:Automated photo tagging is essential to make massive unlabeled photos searchable by text search engines. Conventional image annotation approaches, though working reasonably well on small testbeds, are either computationally expensive or inaccurate when dealing with large-scale photo tagging. Recently, with the popularity of networking websites, we observe a massive number of user-tagged referred to as social images, that are available on the web. Unlike traditional web images often contain tags and other user-generated content, which offer a new opportunity to resolve some long-standing challenges in multimedia. In this work, we aim to address the challenge of large-scale automated photo tagging by exploring the images. We present a retrieval based approach for automated photo tagging. To tag a test image, the proposed approach first retrieves k images that share the largest visual similarity with the test image. The tags of the test image are then derived based on the tagging of the similar images. Due to the well-known semantic gap issue, a regular Euclidean distance-based retrieval method often fails to find semantically relevant images. To address the challenge of semantic gap, we propose a novel probabilistic distance metric learning scheme that (1) automatically derives constraints from the uncertain side information, and (2) efficiently learns a distance metric from the derived constraints. We apply the proposed technique to automated photo tagging tasks based on a image testbed with over 200,000 images crawled from Flickr. Encouraging results show that the proposed technique is effective and promising for automated photo tagging.

Unsupervised Image Categorization Using Constrained Entropy-Regularized Likelihood Learning with Pairwise Constraints

A Semi-Supervised Learning Algorithm on Gaussian Mixture with Automatic Model Selection

Entropy Regularization, Automatic Model Selection, And Unsupervised Image Segmentation

Unsupervised learning of finite mixtures using entropy regularization and its application to image segmentation

Semisupervised Prior Free Rare Category Detection with Mixed Criteria

A Pca Based Automatic Image Categorization Approach Using Dominant Color Features

Image Categorization Via Robust Plsa

Learning Semi-supervised Gaussian Mixture Models for Generalized Category Discovery

Distance Metric Learning from Uncertain Side Information with Application to Automated Photo Tagging

InfoMatch: Entropy Neural Estimation for Semi-Supervised Image Classification

Combining Latent Semantic Learning and Reduced Hypergraph Learning for Semi-Supervised Image Categorization

Semantic image classification using statistical local spatial relations model

Class Probability Space Regularization for Semi-Supervised Semantic Segmentation

Regularized Semi-Supervised Latent Dirichlet Allocation for Visual Concept Learning

Detection and Segmentation of Unlearned Objects in Unknown Environment

ECMEE: Expert Constrained Multi-Expert Ensembles with Category Entropy Minimization for long-tailed visual recognition

Image Classification Via Semi-supervised Plsa

Exploiting Unsupervised and Supervised Constraints for Subspace Clustering

ESL: Entropy-guided Self-supervised Learning for Domain Adaptation in Semantic Segmentation

Efficient multi-class unlabeled constrained semi-supervised SVM.

Image Annotations Based on Semi-supervised Clustering with Semantic Soft Constraints.