Abstract:Discourse information, as postulated by popular discourse theories, such as RST and PDTB, has been shown to improve an increasing number of downstream NLP tasks, showing positive effects and synergies of discourse with important real-world applications. While methods for incorporating discourse become more and more sophisticated, the growing need for robust and general discourse structures has not been sufficiently met by current discourse parsers, usually trained on small scale datasets in a strictly limited number of domains. This makes the prediction for arbitrary tasks noisy and unreliable. The overall resulting lack of high-quality, high-quantity discourse trees poses a severe limitation to further progress. In order the alleviate this shortcoming, we propose a new strategy to generate tree structures in a task-agnostic, unsupervised fashion by extending a latent tree induction framework with an auto-encoding objective. The proposed approach can be applied to any tree-structured objective, such as syntactic parsing, discourse parsing and others. However, due to the especially difficult annotation process to generate discourse trees, we initially develop a method to generate larger and more diverse discourse treebanks. In this paper we are inferring general tree structures of natural text in multiple domains, showing promising results on a diverse set of tasks.

Unleashing the Power of Neural Discourse Parsers -- A Context and Structure Aware Approach Using Large Scale Pretraining

RST Discourse Parsing As Text-to-Text Generation

RST Discourse Parsing with Second-Stage EDU-Level Pre-training

Recursive Deep Models for Discourse Parsing

Predicting Above-Sentence Discourse Structure Using Distant Supervision from Topic Segmentation

An End-to-End Document-Level Neural Discourse Parser Exploiting Multi-Granularity Representations

RST-style Discourse Parsing Guided by Document-level Content Structures

Large Discourse Treebanks from Scalable Distant Supervision

DMRST: A Joint Framework for Document-Level Multilingual RST Discourse Segmentation and Parsing

A Top-Down Neural Architecture towards Text-Level Parsing of Discourse Rhetorical Structure

Cross-lingual RST Discourse Parsing

Unsupervised Learning of Discourse Structures using a Tree Autoencoder

Bilingual Rhetorical Structure Parsing with Large Parallel Annotations

From Sentiment Annotations to Sentiment Prediction through Discourse Augmentation

Improved Discourse Parsing with Two-Step Neural Transition-Based Model

Improved Document Modelling with a Neural Discourse Parser

Better Document-level Sentiment Analysis from RST Discourse Parsing

Can we obtain significant success in RST discourse parsing by using Large Language Models?

Transition-Based Discourse Parsing with Multilayer Stack Long Short Term Memory

Towards Domain-Independent Supervised Discourse Parsing Through Gradient Boosting

Universal Discourse Representation Structure Parsing