CREATIVESUMM: Shared Task on Automatic Summarization for Creative Writing
Divyansh Agarwal,Alexander R. Fabbri,Simeng Han,Wojciech Kryściński,Faisal Ladhak,Bryan Li,Kathleen McKeown,Dragomir Radev,Tianyi Zhang,Sam Wiseman
DOI: https://doi.org/10.48550/arXiv.2211.05886
2022-12-07
Abstract:This paper introduces the shared task of summarizing documents in several creative domains, namely literary texts, movie scripts, and television scripts. Summarizing these creative documents requires making complex literary interpretations, as well as understanding non-trivial temporal dependencies in texts containing varied styles of plot development and narrative structure. This poses unique challenges and is yet underexplored for text summarization systems. In this shared task, we introduce four sub-tasks and their corresponding datasets, focusing on summarizing books, movie scripts, primetime television scripts, and daytime soap opera scripts. We detail the process of curating these datasets for the task, as well as the metrics used for the evaluation of the submissions. As part of the CREATIVESUMM workshop at COLING 2022, the shared task attracted 18 submissions in total. We discuss the submissions and the baselines for each sub-task in this paper, along with directions for facilitating future work in the field.
Computation and Language