Abstract:This paper investigates the problem of cross-lingual transfer parsing, aiming at inducing dependency parsers for low-resource languages while using only training data from a resource-rich language (e.g., English). Existing model transfer approaches typically don't include lexical features, which are not transferable across languages. In this paper, we bridge the lexical feature gap by using distributed feature representations and their composition. We provide two algorithms for inducing cross-lingual distributed representations of words, which map vocabularies from two different languages into a common vector space. Consequently, both lexical features and non-lexical features can be used in our model for cross-lingual transfer. Furthermore, our framework is flexible enough to incorporate additional useful features such as cross- lingual word clusters. Our combined contributions achieve an average relative error reduction of 10.9% in labeled attachment score as compared with the delexicalized parser, trained on English universal treebank and transferred to three other languages. It also significantly outperforms state-of-the-art delexicalized models augmented with projected cluster features on identical data. Finally, we demonstrate that our models can be further boosted with minimal supervision (e.g., 100 annotated sentences) from target languages, which is of great significance for practical usage.

Cross-Lingual Dependency Parsing Using Code-Mixed TreeBank

Chinese Dependency Parsing Based on Treebank

Cross-lingual Dependency Parsing Based on Distributed Representations.

A Chinese Dependency Syntax for Treebanking

Cross-Lingual Dependency Parsing by POS-Guided Word Reordering.

Exploiting Heterogeneous Treebanks for Parsing.

Constructing Code-mixed Universal Dependency Forest for Unbiased Cross-lingual Relation Extraction

Universal Dependencies Parsing For Colloquial Singaporean English

A Distributed Representation-Based Framework for Cross-Lingual Transfer Parsing.

Classifying Syntactic Categories in the Chinese Dependency Network.

Using A Chinese Treebank to Measure Dependency Distance

Enhancing Discourse Dependency Parsing with Sentence Dependency Parsing: A Unified Generative Method Based on Code Representation

A Universal Framework for Inductive Transfer Parsing Across Multi-typed Treebanks.

Exploiting Multi-typed Treebanks for Parsing with Deep Multi-task Learning.

A Representation Learning Framework For Multi-Source Transfer Parsing

Chinese Syntactic and Typological Properties Based on Dependency Syntactic Treebanks

On Difficulties of Cross-Lingual Transfer with Order Differences: A Case Study on Dependency Parsing

A Simple Yet Effective Joint Training Method for Cross-Lingual Universal Dependency Parsing.

Joint Parsing and Translation

Transition-Based Dependency Parsing with Long Distance Collocations

Curriculum-Style Fine-Grained Adaption for Unsupervised Cross-Lingual Dependency Transfer