A storm-based real-time micro-blogging burst event detection system

Wang Yiding,Xu Ruifeng,Liu Bin,Gui Lin,Tang Bin
DOI: https://doi.org/10.1007/978-3-662-45652-1_20
2014-01-01
Abstract:Micro-blogging is becoming an important information source of breaking news event. Since micro-blogs are real-time unbounded stream with complex relationships, traditional burst event detection techniques do not work well. This paper presents the RBEDS which is a real-time burst event detection system following Storm distributed streaming processing framework. K-Means clustering approach and burst feature detection approach are performed to identify candidate burst events, respectively. Their outputs are incorporated to generate final event detection results. Such operation is implemented as a Storm Topology. The proposed system is evaluated on a large Sina micro-blogging dataset. The achieved system performance shows that the RBEDS system may detect burst events with good timeliness, effectiveness and scalability. © Springer-Verlag Berlin Heidelberg 2014.
What problem does this paper attempt to address?