Abstract:In this paper, we introduce a new topic model to understand the chaotic microblogging environment by using hashtag graphs. Inferring topics on Twitter becomes a vital but challenging task in many important applications. The shortness and informality of tweets leads to extreme sparse vector representations with a large vocabulary. This makes the conventional topic models (e.g., latent Dirichlet allocation [1] and latent semantic analysis [2]) fail to learn high quality topic structures. Tweets are always showing up with rich user-generated hashtags. The hashtags make tweets semi-structured inside and semantically related to each other. Since hashtags are utilized as keywords in tweets to mark messages or to form conversations, they provide an additional path to connect semantically related words. In this paper, treating tweets as semi-structured texts, we propose a novel topic model, denoted as Hashtag Graph-based Topic Model (HGTM) to discover topics of tweets. By utilizing hashtag relation information in hashtag graphs, HGTM is able to discover word semantic relations even if words are not co-occurred within a specific tweet. With this method, HGTM successfully alleviates the sparsity problem. Our investigation illustrates that the user-contributed hashtags could serve as weakly-supervised information for topic modeling, and the relation between hashtags could reveal latent semantic relation between words. We evaluate the effectiveness of HGTM on tweet (hashtag) clustering and hashtag classification problems. Experiments on two real-world tweet data sets show that HGTM has strong capability to handle sparseness and noise problem in tweets. Furthermore, HGTM can discover more distinct and coherent topics than the state-of-the-art baselines.

Microblog Topic Mining Based on Hashtag

Topic Mining from Microblogs Based on MB-HDP Model

Mining User Interest in Microblogs with a User-Topic Model

MB-ToT: an Effective Model for Topic Mining in Microblogs

Hashtag Graph Based Topic Model for Tweet Mining

Using Hashtag Graph-Based Topic Model to Connect Semantically-Related Words Without Co-Occurrence in Microblogs

Large scale microblog mining using distributed MB-LDA.

What To Tag Your Microblog: Hashtag Recommendation Based On Topic Analysis And Collaborative Filtering

Topic model-based micro-blog user interest analysis

A System to Manage and Mine Microblogging Data.

Automatic Hashtag Recommendation for Microblogs Using Topic-Specific Translation Model.

A Personalized Hashtag Recommendation Approach Using LDA-based Topic Model in Microblog Environment

An Improved Latent Dirichlet Allocation Model for Hot Topic Extraction

Detection and Extraction of Hot Topics on Chinese Microblogs

Analysis of Topic Models on Modeling MicroBlog User Interestingness

Mining User Interests and Change Patterns in Microblog

Topic representation model based on microblogging behavior analysis

Detecting Global and Local Topics Via Mining Twitter Data

Content Tracking by Leveraging Hashtag and Time Information in Twitter Social Media.

Mining Key Users of Microblog Topics Based on Trust Model

A Research of Hot Topic Detection through Microblogging