Abstract: Span-extraction reading comprehension models have made tremendous advances enabled by the availability of large-scale, high-quality training datasets. Despite such rapid progress and widespread application, extractive reading comprehension datasets in languages other than English remain scarce, and creating such a sufficient amount of training data for each language is costly and even impossible. An alternative to creating large-scale high-quality monolingual span-extraction training datasets is to develop multilingual modeling approaches and systems which can transfer to the target language without requiring training data in that language. In this paper, in order to solve the scarce availability of extractive reading comprehension training data in the target language, we propose a multilingual extractive reading comprehension approach called XLRC by simultaneously modeling the existing extractive reading comprehension training data in a multilingual environment using self-adaptive attention and multilingual attention. Specifically, we firstly construct multilingual parallel corpora by translating the existing extractive reading comprehension datasets (i.e., CMRC 2018) from the target language (i.e., Chinese) into different language families (i.e., English). Secondly, to enhance the final target representation, we adopt self-adaptive attention (SAA) to combine self-attention and inter-attention to extract the semantic relations from each pair of the target and source languages. Furthermore, we propose multilingual attention (MLA) to learn the rich knowledge from various language families. Experimental results show that our model outperforms the state-of-the-art baseline (i.e., RoBERTa_Large) on the CMRC 2018 task, which demonstrate the effectiveness of our proposed multi-lingual modeling approach and show the potentials in multilingual NLP tasks.

Spans, Not Tokens: A Span-Centric Model for Multi-Span Reading Comprehension

A Multilingual Modeling Method for Span-Extraction Reading Comprehension

Correct after Answer: Enhancing Multi-Span Question Answering with Post-Processing Method

MaP: A Matrix-based Prediction Approach to Improve Span Extraction in Machine Reading Comprehension

Multi-Matching Network for Multiple Choice Reading Comprehension

How Many Answers Should I Give? an Empirical Study of Multi-Answer Reading Comprehension.

SPAN: Understanding a Question with Its Support Answers

HAS-QA: Hierarchical Answer Spans Model for Open-Domain Question Answering

Salient Span Masking for Temporal Understanding

Enhancing Pre-Trained Generative Language Models with Question Attended Span Extraction on Machine Reading Comprehension

Verification mechanism to obtain an elaborate answer span in machine reading comprehension

A Structured Span Selector

CorefQA: Coreference Resolution As Query-based Span Prediction.

Joint Learning of Token Context and Span Feature for Span-Based Nested NER

S-Net: From Answer Extraction to Answer Synthesis for Machine Reading Comprehension

Convolutional Spatial Attention Model for Reading Comprehension with Multiple-Choice Questions

Hierarchical Answer Selection Framework For Multi-Passage Machine Reading Comprehension

Hit the Sweet Spot! Span-Level Ensemble for Large Language Models

Harvesting More Answer Spans from Paragraph beyond Annotation

Coreference Resolution as Query-based Span Prediction

A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension.