Shallow Discourse Annotation for Chinese TED Talks

Wanqiu Long,Xinyi Cai,James E. M. Reid,Bonnie Webber,Deyi Xiong

DOI: https://doi.org/10.48550/arXiv.2003.04032

2020-04-06

Abstract:Text corpora annotated with language-related properties are an important resource for the development of Language Technology. The current work contributes a new resource for Chinese Language Technology and for Chinese-English translation, in the form of a set of TED talks (some originally given in English, some in Chinese) that have been annotated with discourse relations in the style of the Penn Discourse TreeBank, adapted to properties of Chinese text that are not present in English. The resource is currently unique in annotating discourse-level properties of planned spoken monologues rather than of written text. An inter-annotator agreement study demonstrates that the annotation scheme is able to achieve highly reliable results.

Computation and Language

What problem does this paper attempt to address?

The problem this paper attempts to address is the current lack of resources for annotating features of Chinese spoken discourse, especially in planned monologues (such as TED talks). Although there are several Chinese discourse annotation corpora, they mainly focus on written texts, particularly news texts, and there is relatively little research on the annotation of spoken discourse. Additionally, most existing Chinese discourse annotation work is based on the PDTB-2 framework and does not fully utilize the new features of PDTB-3.

Specifically, the paper aims to:
1. **Create a new Chinese discourse annotation resource**: By annotating discourse relations in TED talks, provide a unique annotation dataset specifically targeting the features of Chinese spoken discourse.
2. **Adapt to the characteristics of Chinese spoken language**: Based on the PDTB-3 framework, adjust the annotation scheme to accommodate the unique connectives and discourse relations of Chinese spoken language.
3. **Improve annotation consistency and reliability**: Ensure high consistency and reliability of the annotation results through detailed annotation guidelines and multiple discussions.
4. **Promote research in natural language processing**: Provide high-quality training data for tasks such as Chinese spoken discourse analysis, machine translation, and automatic summarization.

Through these efforts, the paper fills the gap in the field of Chinese spoken discourse annotation and provides valuable resources for related research.