Abstract:Recent years have witnessed increased efforts on detecting topics and events from Web search logs, since this kind of data not only capture web content but also reflect the users’ activities. However, the majority of existing work is focused on exploiting clustering techniques for topic and event detection. Due to the huge size and the evolving nature of Web data, existing clustering approaches are limited to meet the real-time demand. To that end, in this article, we propose a method called LETD to detect evolving topics in a timely manner. Also, we design the techniques to extract events from topics and to infer the evolving relationship among the events. For topic detection, we first provide a measurement to select the important URLs, which are most likely to describe a real-life topic. Then, starting from these selected URLs, we exploit the local expansion method to find other topic-related URLs. Moreover, in the LETD framework, we design algorithms based on Random Walk and Markov Random Fields (MRF), respectively. Because the LETD method exploits a divide-and-conquer strategy to process the data, it is more efficient than existing methods based on clustering techniques. To better illustrate the LETD framework, we develop a demo system StoryTeller which can discover hot topics and events, infer the evolving relationships among events, and visualize information in a storytelling way. This demo system can provide a global view of the topic development and help users target the interesting events more conveniently. Finally, experimental results on real-world Microsoft click-through data have shown that StoryTeller can find real-life hot topics and meaningful evolving relationships among events, and has also demonstrated the efficiency and effectiveness of the LETD method.

TOM Algorithm in Distributed Topic Maps Merging

Document Clustering Based on Probabilistic Topic Model

Topic discovery based on dual EM merging.

The Realization of Agriculture Model Component Sharing through Topic Map Merging

The Technology of Information Merging in Object Recognition

Topic Mining over Asynchronous Text Sequences

A novel document similarity measure based on earth mover's distance

Simultaneous Topology and Loss Tomography Via a Modified Theme Dictionary Model

A generalized topic modeling approach for maven search

Mining common topics from multiple asynchronous text streams.

An Effective Approach for Topic-Specific Opinion Summarization

Research on Mining Common Concern Via Infinite Topic Modelling

Thread Cleaning and Merging for Microblog Topic Detection.

Mining Cohesive Domain Topics from Source Code

LI-MR: A Local Iteration Map/Reduce Model and Its Application to Mine Community Structure in Large-Scale Networks

Analysis on Topic Maps and Its Application Case

A comparison of citation-based clustering and topic modeling for science mapping

Detecting and Tracking Topics and Events from Web Search Logs.

Topic Discovery for Streaming Short Texts with CTM.

Crowd-Guided Entity Matching with Consolidated Textual Data

Efficient and Distributed Large-Scale 3D Map Registration using Tomographic Features