Multilingual Coreference Resolution in Low-resource South Asian Languages

Ritwik Mishra,Pooja Desur,Rajiv Ratn Shah,Ponnurangam Kumaraguru

2024-03-23

Abstract:Coreference resolution involves the task of identifying text spans within a discourse that pertain to the same real-world entity. While this task has been extensively explored in the English language, there has been a notable scarcity of publicly accessible resources and models for coreference resolution in South Asian languages. We introduce a Translated dataset for Multilingual Coreference Resolution (TransMuCoRes) in 31 South Asian languages using off-the-shelf tools for translation and word-alignment. Nearly all of the predicted translations successfully pass a sanity check, and 75% of English references align with their predicted translations. Using multilingual encoders, two off-the-shelf coreference resolution models were trained on a concatenation of TransMuCoRes and a Hindi coreference resolution dataset with manual annotations. The best performing model achieved a score of 64 and 68 for LEA F1 and CoNLL F1, respectively, on our test-split of Hindi golden set. This study is the first to evaluate an end-to-end coreference resolution model on a Hindi golden set. Furthermore, this work underscores the limitations of current coreference evaluation metrics when applied to datasets with split antecedents, advocating for the development of more suitable evaluation metrics.

Artificial Intelligence

What problem does this paper attempt to address?

The paper primarily focuses on addressing the issue of multilingual coreference resolution in low-resource South Asian languages. Specifically, the research objectives include the following aspects:

1. **Constructing a Multilingual Coreference Resolution Dataset**: Due to the relative scarcity of publicly available coreference resolution resources and models for South Asian languages, the authors created a translated dataset named TransMuCoRes to support multilingual coreference resolution tasks for 31 South Asian languages. This dataset was generated using existing translation tools and word alignment methods.

2. **Training and Evaluating Coreference Resolution Models**: Utilizing multilingual encoders (such as mBERT and XLM-RoBERTa), the authors fine-tuned two existing coreference resolution models (wl-coref and fast-coref) and trained them on the TransMuCoRes dataset as well as a manually annotated Hindi coreference resolution dataset. These models aim to address the lack of such tools in South Asian languages.

3. **Limitations of Evaluation Metrics**: The paper also discusses the limitations of current coreference resolution evaluation metrics (such as CoNLL and LEA metrics) when dealing with data containing split antecedents, and calls for the development of evaluation metrics better suited to such data.

In summary, this research aims to provide multilingual coreference resolution datasets and models for low-resource South Asian languages and highlights the need for improved evaluation metrics to accommodate more diverse language structures and data types.