Abstract:This paper investigates the problem of cross-lingual transfer parsing, aiming at inducing dependency parsers for low-resource languages while using only training data from a resource-rich language (e.g., English). Existing model transfer approaches typically don't include lexical features, which are not transferable across languages. In this paper, we bridge the lexical feature gap by using distributed feature representations and their composition. We provide two algorithms for inducing cross-lingual distributed representations of words, which map vocabularies from two different languages into a common vector space. Consequently, both lexical features and non-lexical features can be used in our model for cross-lingual transfer. Furthermore, our framework is flexible enough to incorporate additional useful features such as cross- lingual word clusters. Our combined contributions achieve an average relative error reduction of 10.9% in labeled attachment score as compared with the delexicalized parser, trained on English universal treebank and transferred to three other languages. It also significantly outperforms state-of-the-art delexicalized models augmented with projected cluster features on identical data. Finally, we demonstrate that our models can be further boosted with minimal supervision (e.g., 100 annotated sentences) from target languages, which is of great significance for practical usage.

Incremental Parsing with Minimal Features Using Bi-Directional LSTM

Incremental Graph-based Neural Dependency Parsing.

Improving Feature-Rich Transition-Based Constituent Parsing Using Recurrent Neural Networks.

Shift-Reduce Constituent Parsing with Neural Lookahead Features.

HC-search for Incremental Parsing

Improved Character-Based Chinese Dependency Parsing by Using Stack-Tree LSTM.

A Fast and Lightweight System for Multilingual Dependency Parsing.

Transition-Based Discourse Parsing with Multilayer Stack Long Short Term Memory

A Neural Probabilistic Structured-Prediction Model for Transition-Based Dependency Parsing.

Bilingually-constrained (monolingual) Shift-Reduce Parsing

A Neural Transition-Based Approach for Semantic Dependency Graph Parsing

Graph-based Dependency Parsing with Bidirectional LSTM.

Transition-based Neural RST Parsing with Implicit Syntax Features.

Universal Dependencies Parsing For Colloquial Singaporean English

A Distributed Representation-Based Framework for Cross-Lingual Transfer Parsing.

Improved Discourse Parsing with Two-Step Neural Transition-Based Model

Transition-Based Dependency Parsing with Stack Long Short-Term Memory

Self-attentive Biaffine Dependency Parsing.

Cross-lingual Dependency Parsing Based on Distributed Representations.

SLDP: Sequence Learning Dependency Parsing Model Using Long Short-Term Memory

Span-Based Constituency Parsing with a Structure-Label System and Provably Optimal Dynamic Oracles