Abstract:Most of the unsupervised dependency parsers are based on probabilistic generative models that learn the joint distribution of the given sentence and its parse. Probabilistic generative models usually explicit decompose the desired dependency tree into factorized grammar rules, which lack the global features of the entire sentence. In this paper, we propose a novel probabilistic model called discriminative neural dependency model with valence (D-NDMV) that generates a sentence and its parse from a continuous latent representation, which encodes global contextual information of the generated sentence. We propose two approaches to model the latent representation: the first deterministically summarizes the representation from the sentence and the second probabilistically models the representation conditioned on the sentence. Our approach can be regarded as a new type of autoencoder model to unsupervised dependency parsing that combines the benefits of both generative and discriminative techniques. In particular, our approach breaks the context-free independence assumption in previous generative approaches and therefore becomes more expressive. Our extensive experimental results on seventeen datasets from various sources show that our approach achieves competitive accuracy compared with both generative and discriminative state-of-the-art unsupervised dependency parsers.

Lexicalized Neural Unsupervised Dependency Parsing

Enhancing Unsupervised Generative Dependency Parser With Contextual

Dependency Grammar Induction with Neural Lexicalization and Big Training Data

Second-Order Unsupervised Neural Dependency Parsing

A Survey of Unsupervised Dependency Parsing.

Improving AMR Parsing by Exploiting the Dependency Parsing As an Auxiliary Task.

Probabilistic Graph-Based Dependency Parsing With Convolutional Neural Network

Universal Dependencies Parsing For Colloquial Singaporean English

A Neural Transition-Based Approach for Semantic Dependency Graph Parsing

High-order Graph-based Neural Dependency Parsing.

Neural Maximum Subgraph Parsing for Cross-Domain Semantic Dependency Analysis.

Unsupervised Dependency Graph Network

A Neural Probabilistic Structured-Prediction Model for Transition-Based Dependency Parsing.

SLDP: Sequence Learning Dependency Parsing Model Using Long Short-Term Memory

A Practical Chinese Dependency Parser Based on A Large-scale Dataset

A Fast and Lightweight System for Multilingual Dependency Parsing.

Combining Generative and Discriminative Approaches to Unsupervised Dependency Parsing via Dual Decomposition

Neural Probabilistic Model for Non-projective MST Parsing

RNN-Based Sequence-Preserved Attention for Dependency Parsing.

Transition-based Dependency Parsing Using Two Heterogeneous Gated Recursive Neural Networks.

Dependency Parsing Model based on Supervised Learning:A Survey