Abstract:Streams of short text, such as news titles, enable us to effectively and efficiently learn the real world events that occur anywhere and anytime. Short text messages that are companied by timestamps and generally brief events using only a few words differ from other longer text documents, such as web pages, news stories, blogs, technical papers and books. For example, few words repeat in the same news titles, thus frequency of the term (i.e., TF) is not as important in short text corpus as in longer text corpus. Therefore, analysis of short text faces new challenges. Also, detecting and tracking events through short text analysis need to reliably identify events from constant topic clusters; however, existing methods, such as Latent Dirichlet Allocation (LDA), generates different topic results for a corpus at different executions. In this paper, we provide a Finding Topic Clusters using Co-occurring Terms (FTCCT) algorithm to automatically generate topics from a short text corpus, and develop an Event Evolution Mining (EEM) algorithm to discover hot events and their evolutions (i.e., the popularity degrees of events changing over time). In FTCCT, a term (i.e., a single word or a multiple-words phrase) belongs to only one topic in a corpus. Experiments on news titles of 157 countries within 4 months (from July to October, 2013) demonstrate that our FTCCT-based method (combining FTCCT and EEM) achieves far higher quality of the event's content and description words than LDA-based method (combining LDA and EEM) for analysis of streams of short text. Our method also visualizes the evolutions of the hot events. The discovered world-wide event evolutions have explored some interesting correlations of the world-wide events; for example, successive extreme weather phenomenon occur in different locations - typhoon in Hong Kong and Philippines followed hurricane and storm flood in Mexico in September 2013.

Online Detection of Bursty Events and Their Evolution in News Streams

Online Event Detection in News Stream

Online Burst Detection Over High Speed Short Text Streams

Socialanalysis: A Real-Time Query And Mining System From Social Media Data Streams

Mining Event Temporal Boundaries from News Corpora Through Evolution Phase Discovery

Adaptive Online Event Detection in News Streams.

Temporal and Social Context Based Burst Detection from Folksonomies.

Burst events detection on micro-blogging.

Bursty Feature Based Topic Detction and Summarization

Identifying Event-related Bursts via Social Media Activities.

Detecting Lasting and Abrupt Bursts in Data Streams Using Two-Layered Wavelet Tree

Event Evolution Tracking from Streaming Social Posts

Probabilistic Topic Model Based Approach for Detecting Bursty Events from Social Media Data

A Novel Burst-based Text Representation Model for Scalable Event Detection.

An Online Detection and Tracking Method for Bursty Topics

Trend Analysis for Large Document Streams

Detecting Bursty Events in Collaborative Tagging Systems

Real-time Spread Burst Detection in Data Streaming

Mining Streams of Short Text for Analysis of World-Wide Event Evolutions

Efficient Early Event Detector for Streaming Sequence.

Real-time Event Detection on Social Data Streams