Abstract:Multi-task learning has recently become a very active field in deep learning research. In contrast to learning a single task in isolation, multiple tasks are learned at the same time, thereby utilizing the training signal of related tasks to improve the performance on the respective machine learning tasks. Related work shows various successes in different domains when applying this paradigm and this thesis extends the existing empirical results by evaluating multi-task learning in four different scenarios: argumentation mining, epistemic segmentation, argumentation component segmentation, and grapheme-to-phoneme conversion. We show that multi-task learning can, indeed, improve the performance compared to single-task learning in all these scenarios, but may also hurt the performance. Therefore, we investigate the reasons for successful and less successful applications of this paradigm and find that dataset properties such as entropy or the size of the label inventory are good indicators for a potential multi-task learning success and that multi-task learning is particularly useful if the task at hand suffers from data sparsity, i.e. a lack of training data. Moreover, multi-task learning is particularly effective for long input sequences in our experiments. We have observed this trend in all evaluated scenarios. Finally, we develop a highly configurable and extensible sequence tagging framework which supports multi-task learning to conduct our empirical experiments and to aid future research regarding the multi-task learning paradigm and natural language processing.

Multilingual Argument Mining: Datasets and Analysis

Argument Mining in Data Scarce Settings: Cross-lingual Transfer and Few-shot Techniques

Cross-lingual Argument Mining in the Medical Domain

Argumentation Mining in User-Generated Web Discourse

Multi-Task Learning for Argumentation Mining

Transfer Learning of Lexical Semantic Families for Argumentative Discourse Units Identification

RuArg-2022: Argument Mining Evaluation

Can Large Language Models perform Relation-based Argument Mining?

NLAS-multi: A Multilingual Corpus of Automatically Generated Natural Language Argumentation Schemes

Cross-topic Argument Mining from Heterogeneous Sources Using Attention-based Neural Networks

Active Learning for Argument Mining: A Practical Approach

Exploring the Potential of Large Language Models in Computational Argumentation

Enhancing Legal Argument Mining with Domain Pre-training and Neural Networks

Assessing Open-Source Large Language Models on Argumentation Mining Subtasks

Can Unsupervised Knowledge Transfer from Social Discussions Help Argument Mining?

Towards a Benchmark of Natural Language Arguments

Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation

Towards a Holistic View on Argument Quality Prediction

Diversity Over Size: On the Effect of Sample and Topic Sizes for Topic-Dependent Argument Mining Datasets

End-to-end Argument Mining with Cross-corpora Multi-task Learning

Multi-Task Learning Improves Performance In Deep Argument Mining Models