Abstract:Most of the unsupervised dependency parsers are based on probabilistic generative models that learn the joint distribution of the given sentence and its parse. Probabilistic generative models usually explicit decompose the desired dependency tree into factorized grammar rules, which lack the global features of the entire sentence. In this paper, we propose a novel probabilistic model called discriminative neural dependency model with valence (D-NDMV) that generates a sentence and its parse from a continuous latent representation, which encodes global contextual information of the generated sentence. We propose two approaches to model the latent representation: the first deterministically summarizes the representation from the sentence and the second probabilistically models the representation conditioned on the sentence. Our approach can be regarded as a new type of autoencoder model to unsupervised dependency parsing that combines the benefits of both generative and discriminative techniques. In particular, our approach breaks the context-free independence assumption in previous generative approaches and therefore becomes more expressive. Our extensive experimental results on seventeen datasets from various sources show that our approach achieves competitive accuracy compared with both generative and discriminative state-of-the-art unsupervised dependency parsers.

Dependency Grammar Induction with Neural Lexicalization and Big Training Data

Lexicalized Neural Unsupervised Dependency Parsing

Dependency Induction Through the Lens of Visual Perception

Bilingually-Guided Monolingual Dependency Grammar Induction.

Enhancing Discourse Dependency Parsing with Sentence Dependency Parsing: A Unified Generative Method Based on Code Representation

Multilingual Grammar Induction with Continuous Language Identification.

Leveraging Grammar Induction for Language Understanding and Generation

Universal Dependencies Parsing For Colloquial Singaporean English

Multilingual Syntax-aware Language Modeling through Dependency Tree Conversion

Enhancing Unsupervised Generative Dependency Parser With Contextual

Controlled Evaluation of Grammatical Knowledge in Mandarin Chinese Language Models

Dependency-based N-Gram Models for General Purpose Sentence Realisation

Transition-based Dependency Parsing Using Two Heterogeneous Gated Recursive Neural Networks.

Dependency Transformer Grammars: Integrating Dependency Structures into Transformer Language Models

Improving Tree-Based Neural Machine Translation with Dynamic Lexicalized Dependency Encoding

Joint Learning of Constituency and Dependency Grammars by Decomposed Cross-Lingual Induction

Utilizing Dependency Language Models for Graph-Based Dependency Parsing Models

Generalizations across filler-gap dependencies in neural language models

Incremental Graph-based Neural Dependency Parsing.

Nbest Dependency Parsing with linguistically rich models.

A Neural Probabilistic Structured-Prediction Model for Transition-Based Dependency Parsing.