Abstract:Nowadays the locations of social images play an important role in geographic knowledge discovery. However, most social images still lack the location information, driving location estimation for social images to have recently become an active research topic. With the rapid growth of social images, new challenges have been posed: 1) data quality of social images is an issue because they are often associated with noises and error-prone user-generated content, such as junk comments and misspelled words; and 2) data sparsity exists in social images despite the large volume, since most of them are unevenly distributed around the world and their contextual information is often missing or incomplete. In this paper, we propose a spatial-aware multimodal location estimation (SMLE) framework to tackle the above challenges. Specifically, a spatial-aware language model (SLM) is proposed to detect the high quality location-indicative tags from large datasets. We also design a spatial-aware topic model, namely spatial-aware regularized latent semantic indexing (SRLSI), to discover geographic topics and alleviate the data sparseness problem existing in language modeling. Taking multi-modalities of social images into consideration, we employ the learning to rank approach to fuse multiple evidences derived from textual features represented by SLM and SRLSI, and visual features represented by bag-of-visual-words (BoVW). Importantly, an ad hoc method is introduced to construct the training dataset with spatial-aware relevance labels for learning to rank training. Finally, given a query image, its location is estimated as the location of its most relevant image returned from the learning to rank model. The proposed framework is evaluated on a public benchmark provided by MediaEval 2013 Placing Task, which contains more than 8.5 million images crawled from Flickr. Extensive experiments on this dataset demonstrate the superior performance of the proposed methods over the state-of-the-art approaches.

Spatial and Semantical Label Inference for Social Media

A Probabilistic Framework for Location Inference from Social Media

STS: Spatial–Temporal–Semantic Personalized Location Recommendation

Spatial-Aware Multimodal Location Estimation For Social Images

Localize Online Social Network User Via Social Sensing

Spatial Topic Modeling in Online Social Media for Location Recommendation

A Spatial-Temporal Topic Model for the Semantic Annotation of POIs in LBSNs

Modeling User Activity Preference by Leveraging User Spatial Temporal Characteristics in LBSNs.

Spatial Semantic Learning for Travel Time Estimation.

Extracting and Analyzing Latent Semantic Characteristics of Locations Using Social Media Data

Spatial Technology and Social Media in Remote Sensing: A Survey

Social Network Search Based on Semantic Analysis and Learning.

On Combining Social Media and Spatial Technology for POI Cognition and Image Localization

Exploiting Spatiotemporal Features To Infer Friendship In Location-Based Social Networks

Dynamic Discovery of Favorite Locations in Spatio-Temporal Social Networks.

Learning Spatiotemporal-Aware Representation for POI Recommendation

Next Location Prediction Using Heterogeneous Graph-Based Fusion Network with Physical and Social Awareness

Spatio-Temporal Topic Modeling In Mobile Social Media For Location Recommendation

Fast Unsupervised Location Category Inference from Highly Inaccurate Mobility Data.

A Deep Multi-Modal Fusion Approach for Semantic Place Prediction in Social Media

Deciphering Human Mobility: Inferring Semantics of Trajectories with Large Language Models