DTELS: Towards Dynamic Granularity of Timeline Summarization

Chenlong Zhang,Tong Zhou,Pengfei Cao,Zhuoran Jin,Yubo Chen,Kang Liu,Jun Zhao
2024-11-14
Abstract:The rapid proliferation of online news has posed significant challenges in tracking the continuous development of news topics. Traditional timeline summarization constructs a chronological summary of the events but often lacks the flexibility to meet the diverse granularity needs. To overcome this limitation, we introduce a new paradigm, Dynamic-granularity TimELine Summarization, (DTELS), which aims to construct adaptive timelines based on user instructions or requirements. This paper establishes a comprehensive benchmark for DTLES that includes: (1) an evaluation framework grounded in journalistic standards to assess the timeline quality across four dimensions: Informativeness, Granular Consistency, Factuality, and Coherence; (2) a large-scale, multi-source dataset with multiple granularity timeline annotations based on a consensus process to facilitate authority; (3) extensive experiments and analysis with two proposed solutions based on Large Language Models (LLMs) and existing state-of-the-art TLS methods. The experimental results demonstrate the effectiveness of LLM-based solutions. However, even the most advanced LLMs struggle to consistently generate timelines that are both informative and granularly consistent, highlighting the challenges of the DTELS task.
Computation and Language
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the fixed - granularity problem existing in traditional Timeline Summarization (TLS) when dealing with news topics. Specifically, traditional timeline summarization methods usually construct static timelines, and their granularity (i.e., the level of detail of events on the timeline) is fixed and cannot be adjusted dynamically according to users' needs or the characteristics of news topics. This fixed - granularity method limits the flexibility and adaptability of timeline summaries in different application scenarios. For example, different readers may have different granularity requirements for the same news topic. A network engineer interested in technical details may need a fine - granularity timeline to track the technical reasons and solutions for data leakage; while for an investor, a coarse - granularity timeline showing the impact of the entire event on investment may be sufficient. In addition, different types of news topics also require different levels of granularity. For example, breaking news (such as local disasters) may require a fine - granularity timeline to track progress and immediate impacts, while long - term topics (such as the Russia - Ukraine war) may require a coarse - granularity timeline to capture broader development trends. Therefore, the paper proposes a new paradigm - Dynamic - granularity TimELineSummarization (DTELS), aiming to construct timeline summaries that can adjust granularity dynamically according to users' needs or the nature of news topics. Through this method, the needs of different user groups can be better met, and the practicality and accuracy of timeline summaries can be improved.