A Temporal Topic Model for New Event Detection

Yu Hong,Yu Zhang,Ting Liu,Sheng Li
DOI: https://doi.org/10.1142/s1793840609002020
2009-01-01
International Journal of Computer Processing Of Languages
Abstract:As an important task in Topic Detection and Tracking (TDT), New Event Detection (NED) aims to monitor the stream of news stories and detect new events reported by the first story of a topic. This paper proposes a Temporal Topic Model (TTM) to describe a topic as a series of events corresponding to different time. NED, based on TTM, firstly identifies whether a story includes the same time expressions with old topics, and then it verifies whether the story and the topics include relevant events corresponding to the expressions. Thus, a story will be determined as a new event, if it includes much few simultaneous relevant events of old topics. Additionally, this paper analyzes the distribution of time expressions to identify both seminal and novel events, by which NED modifies the probabilities of stories to be new events based on whether they include seminal or novel events of old topics. We compare our methods with some existing NED systems on TDT4 corpus, which demonstrate our methods substantially improve the efficiency and accuracy of NED.
What problem does this paper attempt to address?