Abstract:Recent years have witnessed increased efforts on detecting topics and events from Web search logs, since this kind of data not only capture web content but also reflect the users’ activities. However, the majority of existing work is focused on exploiting clustering techniques for topic and event detection. Due to the huge size and the evolving nature of Web data, existing clustering approaches are limited to meet the real-time demand. To that end, in this article, we propose a method called LETD to detect evolving topics in a timely manner. Also, we design the techniques to extract events from topics and to infer the evolving relationship among the events. For topic detection, we first provide a measurement to select the important URLs, which are most likely to describe a real-life topic. Then, starting from these selected URLs, we exploit the local expansion method to find other topic-related URLs. Moreover, in the LETD framework, we design algorithms based on Random Walk and Markov Random Fields (MRF), respectively. Because the LETD method exploits a divide-and-conquer strategy to process the data, it is more efficient than existing methods based on clustering techniques. To better illustrate the LETD framework, we develop a demo system StoryTeller which can discover hot topics and events, infer the evolving relationships among events, and visualize information in a storytelling way. This demo system can provide a global view of the topic development and help users target the interesting events more conveniently. Finally, experimental results on real-world Microsoft click-through data have shown that StoryTeller can find real-life hot topics and meaningful evolving relationships among events, and has also demonstrated the efficiency and effectiveness of the LETD method.

Interactive mining topic evolutionary patterns from internet forums

Query Subtopic Mining Via Subtractive Initialization of Non-negative Sparse Latent Semantic Analysis

Interest Mining in Virtual Learning Environments

A Knowledge-Based Semisupervised Hierarchical Online Topic Detection Framework.

Interactive Topic Modeling Based on Hierarchical Dirichlet Process

Socialanalysis: A Real-Time Query And Mining System From Social Media Data Streams

A model of dynamic interest management: interaction analysis in collaborative virtual environment.

Detecting and Tracking Topics and Events from Web Search Logs.

A LDA Based Model for Topic Evolution: Evidence from Information Science Journals

Dynamic mining for web navigation patterns based on markov model

Modeling Dynamic Multi-Topic Discussions in Online Forums.

ACT-LDA: A Probabilistic Model of Topic, Community and User Influence

Research on Hot Topic Recognition and Its Evolution Analysis Method Based on LDA

The Discovery of Burst Topic and Its Intermittent Evolution in Our Real World

News Topic Discovery Through Community Detection

Mining Topic-Level Opinion Influence in Microblog

Large scale microblog mining using distributed MB-LDA.

Online Visual Analytics of Text Streams

How Hierarchical Topics Evolve in Large Text Corpora.

Research on Mining Common Concern Via Infinite Topic Modelling

An Online Topic Modeling Framework with Topics Automatically Labeled