Abstract:With the rise of Social Media, people obtain and share information almost instantly on a 24/7 basis. Many research areas have tried to gain valuable insights from these large volumes of freely available user generated content. With the goal of extracting knowledge from social media streams that might be useful in the context of intelligent transportation systems and smart cities, we designed and developed a framework that provides functionalities for parallel collection of geo-located tweets from multiple pre-defined bounding boxes (cities or regions), including filtering of non-complying tweets, text pre-processing for Portuguese and English language, topic modeling, and transportation-specific text classifiers, as well as, aggregation and data visualization. We performed an exploratory data analysis of geo-located tweets in 5 different cities: Rio de Janeiro, S\~ao Paulo, New York City, London and Melbourne, comprising a total of more than 43 million tweets in a period of 3 months. Furthermore, we performed a large scale topic modelling comparison between Rio de Janeiro and S\~ao Paulo. Interestingly, most of the topics are shared between both cities which despite being in the same country are considered very different regarding population, economy and lifestyle. We take advantage of recent developments in word embeddings and train such representations from the collections of geo-located tweets. We then use a combination of bag-of-embeddings and traditional bag-of-words to train travel-related classifiers in both Portuguese and English to filter travel-related content from non-related. We created specific gold-standard data to perform empirical evaluation of the resulting classifiers. Results are in line with research work in other application areas by showing the robustness of using word embeddings to learn word similarities that bag-of-words is not able to capture.

Using machine learning methods for disambiguating place references in textual documents

Disambiguating fine-grained place names from descriptions by clustering

SSC: Semantic Scan Context for Large-Scale Place Recognition

Multi-document Chinese Name Disambiguation Based on Latent Semantic Analysis

Geo-referencing Place from Everyday Natural Language Descriptions

A Semantic-Spatial Aware Data Conflation Approach for Place Knowledge Graphs

Using Lexical and Thematic Knowledge for Name Disambiguation.

Towards Effective Disambiguation for Machine Translation with Large Language Models

Automatic Search of Multiword Place Names on Historical Maps

Disambiguating Sentiment Ambiguous Adjectives

Scholar Name Disambiguation with Search-enhanced LLM Across Language

A deep learning approach to recognizing fine-grained expressway location reference from unstructured texts in Chinese

Exploiting textual queries for dynamically visual disambiguation

Word embeddings and recurrent neural networks based on Long-Short Term Memory nodes in supervised biomedical word sense disambiguation

A knowledge-based word sense disambiguation algorithm utilizing syntactic dependency relation

Two Supervised Learning Approaches For Name Disambiguation In Author Citations

Semantic Place Descriptors for Classification and Map Discovery

Social Media Text Processing and Semantic Analysis for Smart Cities

Combining Machine Learning and Human Judgment in Author Disambiguation

A deep learning architecture for semantic address matching

Social Network Based Cross-Document Personal Name Disambiguation