Abstract:Recent years have witnessed increased efforts on detecting topics and events from Web search logs, since this kind of data not only capture web content but also reflect the users’ activities. However, the majority of existing work is focused on exploiting clustering techniques for topic and event detection. Due to the huge size and the evolving nature of Web data, existing clustering approaches are limited to meet the real-time demand. To that end, in this article, we propose a method called LETD to detect evolving topics in a timely manner. Also, we design the techniques to extract events from topics and to infer the evolving relationship among the events. For topic detection, we first provide a measurement to select the important URLs, which are most likely to describe a real-life topic. Then, starting from these selected URLs, we exploit the local expansion method to find other topic-related URLs. Moreover, in the LETD framework, we design algorithms based on Random Walk and Markov Random Fields (MRF), respectively. Because the LETD method exploits a divide-and-conquer strategy to process the data, it is more efficient than existing methods based on clustering techniques. To better illustrate the LETD framework, we develop a demo system StoryTeller which can discover hot topics and events, infer the evolving relationships among events, and visualize information in a storytelling way. This demo system can provide a global view of the topic development and help users target the interesting events more conveniently. Finally, experimental results on real-world Microsoft click-through data have shown that StoryTeller can find real-life hot topics and meaningful evolving relationships among events, and has also demonstrated the efficiency and effectiveness of the LETD method.

Web Event Topic Analysis by Topic Feature Clustering and Extended LDA Model.

Topic Discovery Based on LDA_col Model and Topic Significance Re-ranking.

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey

Large scale microblog mining using distributed MB-LDA.

Detecting and Tracking Topics and Events from Web Search Logs.

Topic Evolution Analysis Based on Cluster Topic Model.

A Weighted Topic Modeling Approach Based on Word Embedding

An Improved Latent Dirichlet Allocation Method For Service Topic Detection

A LDA Model Based Topic Detection Method

News Topic Discovery Through Community Detection

Latent Dirichlet Allocation - An approach for topic discovery

CLDA: an Effective Topic Model for Mining User Interest Preference under Big Data Background

LDAExplore: Visualizing Topic Models Generated Using Latent Dirichlet Allocation

Web Text Classification based on LDA Model

Knowledge-Based Topic Model for Multi-Modal Social Event Analysis

Topic Selection in Latent Dirichlet Allocation.

Sentiment word co-occurrence and knowledge pair feature extraction based LDA short text clustering algorithm

Improving Events Classification with Latent Space Clustering-Based Similarities

Short text classification based on LDA topic model

LDA Meets Word2Vec