Abstract:This paper investigates the problem of cross-lingual transfer parsing, aiming at inducing dependency parsers for low-resource languages while using only training data from a resource-rich language (e.g., English). Existing model transfer approaches typically don't include lexical features, which are not transferable across languages. In this paper, we bridge the lexical feature gap by using distributed feature representations and their composition. We provide two algorithms for inducing cross-lingual distributed representations of words, which map vocabularies from two different languages into a common vector space. Consequently, both lexical features and non-lexical features can be used in our model for cross-lingual transfer. Furthermore, our framework is flexible enough to incorporate additional useful features such as cross- lingual word clusters. Our combined contributions achieve an average relative error reduction of 10.9% in labeled attachment score as compared with the delexicalized parser, trained on English universal treebank and transferred to three other languages. It also significantly outperforms state-of-the-art delexicalized models augmented with projected cluster features on identical data. Finally, we demonstrate that our models can be further boosted with minimal supervision (e.g., 100 annotated sentences) from target languages, which is of great significance for practical usage.

ShanghaiTech at MRP 2019: Sequence-to-Graph Transduction with Second-Order Edge Inference for Cross-Framework Meaning Representation Parsing

SJTU at MRP 2019 - A Transition-Based Multi-Task Parser for Cross-Framework Meaning Representation Parsing.

HIT-SCIR at MRP 2020: Transition-based Parser and Iterative Inference Parser.

Enhanced Universal Dependency Parsing with Second-Order Inference and Mixture of Training Data

SJTU-NICT at MRP 2019 - Multi-Task Learning for End-to-End Uniform Semantic Graph Parsing.

Peking at MRP 2019: Factorization- and Composition-Based Parsing for Elementary Dependency Structures

HIT-SCIR at MRP 2019: A Unified Pipeline for Meaning Representation Parsing Via Efficient Training and Effective Encoding.

A Neural Transition-Based Approach for Semantic Dependency Graph Parsing

Multilingual Dependency-based Syntactic and Semantic Parsing.

Enhanced Universal Dependency Parsing with Automated Concatenation of Embeddings

A Cascaded Syntactic and Semantic Dependency Parsing System.

Transition-Based Chinese Semantic Dependency Graph Parsing.

Second-Order Neural Dependency Parsing with Message Passing and End-to-End Training

A Sketch-Based System for Semantic Parsing

SUDA-Alibaba at MRP 2019: Graph-Based Models with BERT.

A Representation Learning Framework For Multi-Source Transfer Parsing

Microsoft Research Asia's Systems for WMT19

A Distributed Representation-Based Framework for Cross-Lingual Transfer Parsing.

Graph-to-Tree Neural Networks for Learning Structured Input-Output Translation with Applications to Semantic Parsing and Math Word Problem.

Neural Maximum Subgraph Parsing for Cross-Domain Semantic Dependency Analysis.