Abstract: Span-extraction reading comprehension models have made tremendous advances enabled by the availability of large-scale, high-quality training datasets. Despite such rapid progress and widespread application, extractive reading comprehension datasets in languages other than English remain scarce, and creating such a sufficient amount of training data for each language is costly and even impossible. An alternative to creating large-scale high-quality monolingual span-extraction training datasets is to develop multilingual modeling approaches and systems which can transfer to the target language without requiring training data in that language. In this paper, in order to solve the scarce availability of extractive reading comprehension training data in the target language, we propose a multilingual extractive reading comprehension approach called XLRC by simultaneously modeling the existing extractive reading comprehension training data in a multilingual environment using self-adaptive attention and multilingual attention. Specifically, we firstly construct multilingual parallel corpora by translating the existing extractive reading comprehension datasets (i.e., CMRC 2018) from the target language (i.e., Chinese) into different language families (i.e., English). Secondly, to enhance the final target representation, we adopt self-adaptive attention (SAA) to combine self-attention and inter-attention to extract the semantic relations from each pair of the target and source languages. Furthermore, we propose multilingual attention (MLA) to learn the rich knowledge from various language families. Experimental results show that our model outperforms the state-of-the-art baseline (i.e., RoBERTa_Large) on the CMRC 2018 task, which demonstrate the effectiveness of our proposed multi-lingual modeling approach and show the potentials in multilingual NLP tasks.

A Progressive Learning Approach to Chinese SRL Using Heterogeneous Data.

Improving Chinese SRL with Heterogeneous Annotations

Improving Chinese Semantic Role Labeling with English Proposition Bank.

Semantic Role Labeling with Heterogeneous Syntactic Knowledge

An MRC Framework for Semantic Role Labeling

Chinese Semantic Role Labeling with Bidirectional Recurrent Neural Networks

Semantic Role Labeling Integrated with Multilevel Linguistic Cues and Bi-LSTM-CRF

Semantic Role Labeling for Learner Chinese: the Importance of Syntactic Parsing and L2-L1 Parallel Data

Research on Chinese Semantic Role Labeling Based on Ocean Big Data

A Syntax-aware Multi-task Learning Framework for Chinese Semantic Role Labeling

Syntax Aware LSTM Model for Chinese Semantic Role Labeling

Improving Chinese Semantic Role Classification with Hierarchical Feature Selection Strategy.

A Corpus-Based Method to Improve Feature-Based Semantic Role Labeling

Semantic Role Labeling Using Recursive Neural Network

Chinese Semantic Role Labeling with Shallow Parsing.

Syntax-Enhanced Self-Attention-Based Semantic Role Labeling

Joint Chinese Word Segmentation and POS Tagging on Heterogeneous Annotated Corpora with Multiple Task Learning.

Combining constituent and dependency syntactic views for Chinese semantic role labeling

Syntax-aware Multilingual Semantic Role Labeling

A Multilingual Modeling Method for Span-Extraction Reading Comprehension

Zero-shot Cross-lingual Conversational Semantic Role Labeling