Abstract:Multi-task learning has recently become a very active field in deep learning research. In contrast to learning a single task in isolation, multiple tasks are learned at the same time, thereby utilizing the training signal of related tasks to improve the performance on the respective machine learning tasks. Related work shows various successes in different domains when applying this paradigm and this thesis extends the existing empirical results by evaluating multi-task learning in four different scenarios: argumentation mining, epistemic segmentation, argumentation component segmentation, and grapheme-to-phoneme conversion. We show that multi-task learning can, indeed, improve the performance compared to single-task learning in all these scenarios, but may also hurt the performance. Therefore, we investigate the reasons for successful and less successful applications of this paradigm and find that dataset properties such as entropy or the size of the label inventory are good indicators for a potential multi-task learning success and that multi-task learning is particularly useful if the task at hand suffers from data sparsity, i.e. a lack of training data. Moreover, multi-task learning is particularly effective for long input sequences in our experiments. We have observed this trend in all evaluated scenarios. Finally, we develop a highly configurable and extensible sequence tagging framework which supports multi-task learning to conduct our empirical experiments and to aid future research regarding the multi-task learning paradigm and natural language processing.

End-to-end Argument Mining with Cross-corpora Multi-task Learning

Multi-Task Learning Improves Performance In Deep Argument Mining Models

AutoAM: An End-To-End Neural Model for Automatic and Universal Argument Mining

End-to-End Argument Mining for Discussion Threads Based on Parallel Constrained Pointer Architecture

Cross-Genre Argument Mining: Can Language Models Automatically Fill in Missing Discourse Markers?

End-to-End Argument Mining as Augmented Natural Language Generation

Multi-Task Learning for Argumentation Mining

A Joint Framework for Argumentative Text Analysis Incorporating Domain Knowledge

Aspect-Based Argument Mining

Cross-topic Argument Mining from Heterogeneous Sources Using Attention-based Neural Networks

Assessing Open-Source Large Language Models on Argumentation Mining Subtasks

Argument Mining in Data Scarce Settings: Cross-lingual Transfer and Few-shot Techniques

Multilingual Argument Mining: Datasets and Analysis

Can Large Language Models perform Relation-based Argument Mining?

Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation

Active Learning for Argument Mining: A Practical Approach

NLAS-multi: A Multilingual Corpus of Automatically Generated Natural Language Argumentation Schemes

Neural Multi-Task Learning for Stance Prediction

Can Unsupervised Knowledge Transfer from Social Discussions Help Argument Mining?

Cross-lingual Argument Mining in the Medical Domain

IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Tasks