Online Event Detection in News Stream

CHEN Wei,ZHANG Cheng,WANG Can,BU Jia-jun,CHEN Chun,CHEN Hong
DOI: https://doi.org/10.3785/j.issn.1008-973x.2011.06.007
2011-01-01
Abstract:Event detection in news stream is an important research area in topic detection and tracking community.Unfortunately,most of the existing event detection methods are offline and inaccurate.An online event detection algorithm in news stream was introduced.An event consists of a set of bursty features that demonstrates bursty rises in corresponding keywords frequency as the related events emerge.Goodness-of-fit test was applied to find out these features with obvious changes in distribution of term frequency in a news document.Left side significance test was further used to validate all the bursty features occurred in a time span.Finally,evolutionary spectral clustering was applied to group highly correlated bursty features into bursty events.Experiments on the Reuters Corpus Volume 1 show that the proposed method can effectively identify bursty features and timely detect events.The detected events are consistent with corresponding events in real life.
What problem does this paper attempt to address?