Abstract:Dependency syntax has been demonstrated highly useful for a number of natural language processing (NLP) tasks. Typical approaches of utilizing dependency syntax include TreeRNN and Tree-Linearization, both of which exploit explicit 1-best tree outputs from a welltrained parser as inputs. However, these approaches may suffer from error propagation due to the inevitable errors contained in the 1-best tree outputs. In this work, we propose a novel approach to integrate dependency syntax without using the discrete tree outputs. The key idea is to use the intermediate hidden representations of a welltrained encoder-decoder dependency parser, which are referred to as Dependency-based Syntax-Aware Word Representations (Dep-SAWRs). Then, we simply concatenate such DepSAWRs with the conventional context-insensitive word embeddings to compose input word representations, without requiring to modify the model architecture of the downstream tasks. We evaluate the proposed method on four kinds of typical NLP tasks, including sentence classification, sentence matching, sequence labeling and machine translation. Experimental results show that the proposed approach is highly promising. On the one hand, it can utilize dependency syntax effectively, bringing consistently better performance on the four tasks compared with baselines without using syntax. On the other hand, the proposed method can outperform the Tree-RNN and Tree-Linearization approaches in most settings, and meanwhile are highly efficient in syntax integration. In addition, the proposed method would be easily extendable to encoding other structural attributes of language. (C) 2020 Elsevier B.V. All rights reserved.

Hybrid Learning of Syntactic and Semantic Dependencies.

Parsing Syntactic and Semantic Dependencies with Two Single-Stage Maximum Entropy Models.

The Integration of Dependency Relation Classification and Semantic Role Labeling Using Bilayer Maximum Entropy Markov Models

A Joint Syntactic and Semantic Dependency Parsing System based on Maximum Entropy Models.

Discriminative Learning of Syntactic and Semantic Dependencies.

Multilingual Dependency-based Syntactic and Semantic Parsing.

Probabilistic Model for Syntactic and Semantic Dependency Parsing

Integrative Semantic Dependency Parsing Via Efficient Large-Scale Feature Selection

Multilingual Dependency Learning

Chinese Dependency Parsing with Maximum Entropy Principle

Joint POS Tagging and Dependency Parsing with Transition-based Neural Networks

Universal Dependencies Parsing For Colloquial Singaporean English

An integrated system for semantic analysis of Chinese

Semantic Role Lableing System Using Maximum Entropy Classifier

Dependency to Semantics: Structure Transformation and Syntax-Guided Attention for Neural Semantic Parsing.

Joint POS Tagging and Dependence Parsing With Transition-Based Neural Networks

Integration of Multiple Classifiers for Chinese Semantic Dependency Analysis

A Hybrid Method Of Sentiment Key Sentence Identification Using Lexical Semantics And Syntactic Dependencies

High-order Joint Constituency and Dependency Parsing

A Cascaded Syntactic and Semantic Dependency Parsing System.

Dependency-based syntax-aware word representations