Abstract:Social tagging becomes increasingly important to organize and search large-scale community-contributed photos on social websites. To facilitate generating high-quality social tags, tag recommendation by automatically assigning relevant tags to photos draws particular research interest. In this paper, we focus on the personalized tag recommendation task and try to identify user-preferred, geo-location-specific as well as semantically relevant tags for a photo by leveraging rich contexts of the freely available community-contributed photos. For users and geo-locations, we assume they have different preferred tags assigned to a photo, and propose a subspace learning method to individually uncover the both types of preferences. The goal of our work is to learn a unified subspace shared by the visual and textual domains to make visual features and textual information of photos comparable. Considering the visual feature is a lower level representation on semantics than the textual information, we adopt a progressive learning strategy by additionally introducing an intermediate subspace for the visual domain, and expect it to have consistent local structure with the textual space. Accordingly, the unified subspace is mapped from the intermediate subspace and the textual space respectively. We formulate the above learning problems into a united form, and present an iterative optimization with its convergence proof. Given an untagged photo with its geo-location to a user, the user-preferred and the geo-location-specific tags are found by the nearest neighbor search in the corresponding unified spaces. Then we combine the obtained tags and the visual appearance of the photo to discover the semantically and visually related photos, among which the most frequent tags are used as the recommended tags. Experiments on a large-scale data set collected from Flickr verify the effectivity of the proposed solution.

Semi-Supervised Learning on Large-Scale Geotagged Photos for Situation Recognition

From Photo Streams to Evolving Situations.

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Distance Metric Learning from Uncertain Side Information with Application to Automated Photo Tagging

Graph-based Multimodal Semi-Supervised Image Classification

Situation recognition: Visual semantic role labeling for image understanding

Scene Categorization by Deeply Learning Gaze Behavior in a Semisupervised Context

Semi-Supervised Multitask Learning for Scene Recognition.

Inferring Semantic Concepts from Community-Contributed Images and Noisy Tags

Personalized Geo-Specific Tag Recommendation for Photos on Social Websites

Collaborative Filtering Motivated Automatic Photo Tagging

Deep social grouping network for large scenes with multiple subjects

Unsupervised geographically discriminative feature learning for landmark tagging.

Semi-Supervised Scene Classification for Remote Sensing Images Based on CNN and Ensemble Learning.

Learning Multi-context Aware Location Representations from Large-scale Geotagged Images

A Semi-Supervised Siamese Network with Label Fusion for Remote Sensing Image Scene Classification

Semantic context learning with large-scale weakly-labeled image set.

Image/Video Semantic Analysis by Semi-Supervised Learning

Semisupervised Scene Classification for Remote Sensing Images: A Method Based on Convolutional Neural Networks and Ensemble Learning

Geo-location Driven Image Tagging Via Cross-Domain Learning

Learning to Generate Language-Supervised and Open-Vocabulary Scene Graph Using Pre-Trained Visual-Semantic Space