The HIT-SCIR System for End-to-End Parsing of Universal Dependencies

Wanxiang Che,Jiang Guo,Yuxuan Wang,Bo Zheng,Huaipeng Zhao,Yang Liu,Dechuan Teng,Ting Liu

DOI: https://doi.org/10.18653/v1/k17-3005

2017-01-01

Abstract:Wanxiang Che, Jiang Guo, Yuxuan Wang, Bo Zheng, Huaipeng Zhao, Yang Liu, Dechuan Teng, Ting Liu. Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. 2017.

What problem does this paper attempt to address?

Universal Dependencies Parsing For Colloquial Singaporean English

Hongmin Wang,Yue Zhang,GuangYong Leonard Chan,Jie Yang,Hai Leong Chieu

DOI: https://doi.org/10.18653/v1/P17-1159

2017-01-01

Abstract:Singlish can be interesting to the ACL community both linguistically as a major creole based on English, and computationally for information extraction and sentiment analysis of regional social media. We investigate dependency parsing of Singlish by constructing a dependency treebank under the Universal Dependencies scheme, and then training a neural network model by integrating English syntactic knowledge into a state-of-the-art parser trained on the Singlish treebank. Results show that English knowledge can lead to 25% relative error reduction, resulting in a parser of 84.47% accuracies. To the best of our knowledge, we are the first to use neural stacking to improve cross-lingual dependency parsing on low-resource languages. We make both our annotation and parser available for further research.
Enhanced Universal Dependency Parsing with Automated Concatenation of Embeddings

Xinyu Wang,Zixia Jia,Yong Jiang,Kewei Tu

DOI: https://doi.org/10.48550/arXiv.2107.02416

2021-07-06

Abstract:This paper describes the system used in submission from SHANGHAITECH team to the IWPT 2021 Shared Task. Our system is a graph-based parser with the technique of Automated Concatenation of Embeddings (ACE). Because recent work found that better word representations can be obtained by concatenating different types of embeddings, we use ACE to automatically find the better concatenation of embeddings for the task of enhanced universal dependencies. According to official results averaged on 17 languages, our system ranks 2nd over 9 teams.

Computation and Language,Machine Learning
A Universal Framework for Inductive Transfer Parsing Across Multi-typed Treebanks.

Jiang Guo,Wanxiang Che,Haifeng Wang,Ting Liu

2016-01-01

Abstract:Various treebanks have been released for dependency parsing. Despite that treebanks may belong to different languages or have different annotation schemes, they contain common syntactic knowledge that is potential to benefit each other. This paper presents a universal framework for transfer parsing across multi-typed treebanks with deep multi-task learning. We consider two kinds of treebanks as source: the multilingual universal treebanks and the monolingual heterogeneous treebanks. Knowledge across the source and target treebanks are effectively transferred through multi-level parameter sharing. Experiments on several benchmark datasets in various languages demonstrate that our approach can make effective use of arbitrary source treebanks to improve target parsing models.
A Simple Yet Effective Joint Training Method for Cross-Lingual Universal Dependency Parsing.

Danlu Chen,Mengxiao Lin,Zhifeng Hu,Xipeng Qiu

DOI: https://doi.org/10.18653/v1/k18-2026

2018-01-01

Abstract:This paper describes Fudan’s submission to CoNLL 2018’s shared task Universal Dependency Parsing. We jointly train models when two languages are similar according to linguistic typology and then ensemble the models using a simple re-parse algorithm. We outperform the baseline method by 4.4% (2.1%) on average on development (test) set in CoNLL 2018 UD Shared Task.
Exploiting Multi-typed Treebanks for Parsing with Deep Multi-task Learning.

Jiang Guo,Wanxiang Che,Haifeng Wang,Ting Liu

2016-01-01

Abstract:Various treebanks have been released for dependency parsing. Despite that treebanks may belong to different languages or have different annotation schemes, they contain syntactic knowledge that is potential to benefit each other. This paper presents an universal framework for exploiting these multi-typed treebanks to improve parsing with deep multi-task learning. We consider two kinds of treebanks as source: the multilingual universal treebanks and the monolingual heterogeneous treebanks. Multiple treebanks are trained jointly and interacted with multi-level parameter sharing. Experiments on several benchmark datasets in various languages demonstrate that our approach can make effective use of arbitrary source treebanks to improve target parsing models.
Enhanced Universal Dependency Parsing with Second-Order Inference and Mixture of Training Data

Xinyu Wang,Yong Jiang,Kewei Tu

DOI: https://doi.org/10.48550/arXiv.2006.01414

2021-06-02

Abstract:This paper presents the system used in our submission to the \textit{IWPT 2020 Shared Task}. Our system is a graph-based parser with second-order inference. For the low-resource Tamil corpus, we specially mixed the training data of Tamil with other languages and significantly improved the performance of Tamil. Due to our misunderstanding of the submission requirements, we submitted graphs that are not connected, which makes our system only rank \textbf{6th} over 10 teams. However, after we fixed this problem, our system is 0.6 ELAS higher than the team that ranked \textbf{1st} in the official results.

Computation and Language,Machine Learning
Overview of the NLPCC 2019 Shared Task: Cross-Domain Dependency Parsing

Xue Peng,Zhenghua Li,Min Zhang,Rui Wang,Yue Zhang,Luo Si

DOI: https://doi.org/10.1007/978-3-030-32236-6_69

2019-01-01

Abstract: This paper presents an overview of the NLPCC 2019 shared task on cross-domain dependency parsing, including (1) the data annotation process, (2) task settings, (3) methods, results, and analysis of submitted systems and our recent work (Li+19), (4) discussions on related works and future directions. Considering that unsupervised domain adaptation is very difficult and has made limited progress in the past decades, we for the first time setup semi-supervised subtasks that allow to use a few thousand target-domain labeled sentences for training. We provide about 17 K labeled sentences from a balanced corpus as the source domain (BC), and as three target domains 10 K sentences from product comments (PC), 8 K sentences from product blogs (PB), and 3 K sentences from the web fiction named “Zhuxian” (ZX). All information about this task can be found at http://hlt.suda.edu.cn/index.php/Nlpcc-2019-shared-task, including the data sharing agreement.
NJU-Parser: Achievements on Semantic Dependency Parsing.

Guangchao Tang,Bin Li,Shuaishuai Xu,Xinyu Dai,Jiajun Chen

2012-01-01

Abstract:In this paper, we introduce our work on SemEval-2012 task 5: Chinese Semantic Dependency Parsing. Our system is based on MSTParser and two effective methods are proposed: splitting sentence by punctuations and extracting last character of word as lemma. The experiments show that, with a combination of the two proposed methods, our system can improve LAS about one percent and finally get the second prize out of nine participating systems. We also try to handle the multilevel labels, but with no improvement.
Peking: Building Semantic Dependency Graphs with a Hybrid Parser.

Yantao Du,Fan Zhang,Xun Zhang,Weiwei Sun,Xiaojun Wan

DOI: https://doi.org/10.18653/v1/s15-2154

2015-01-01

Abstract:This paper is a description of our system for SemEval-2015 Task 18: Broad-Coverage Semantic Dependency Parsing. We implement a hybrid parser which benefits from both transition-based and graph-based parsing approaches. In particular, the tree approximation method is explored to take advantage of wellstudied tree parsing techniques. Evaluation on multilingual data sets demonstrates that considerably good semantic analysis can be automatically built by applying state-of-the-art data-driven parsing techniques.
The Status of Function Words in Dependency Grammar: A Critique of Universal Dependencies (UD)

Timothy Osborne,Kim Gerdes

DOI: https://doi.org/10.5334/gjgl.537

2019-01-01

Abstract:The article examines the Universal Dependencies (UD) annotation scheme. The UD project is an international initiative to produce treebanks of the world's languages, whereby the treebanks have been annotated in a cross-linguistically consistent manner. A central aspect of the UD annotation scheme is its analysis of function words. The scheme advocates subordinating function words to content words. This article discusses linguistic and practical motivations behind the UD decision to subordinate function words to content words. It demonstrates that UD choices in this area are not supported linguistically. At the same time, the near convertibility of the UD treebanks to a more linguistically motivated annotation format means that the UD initiative remains of great value to linguistics in general.
Peking at MRP 2019: Factorization- and Composition-Based Parsing for Elementary Dependency Structures

Yufei Chen,Yajie Ye,Weiwei Sun

DOI: https://doi.org/10.18653/v1/k19-2016

2019-01-01

Abstract:We design, implement and evaluate two semantic parsers, which represent factorization- and composition-based approaches respectively, for Elementary Dependency Structures (EDS) at the CoNLL 2019 Shared Task on Cross-Framework Meaning Representation Parsing. The detailed evaluation of the two parsers gives us a new perception about parsing into linguistically enriched meaning representations: current neural EDS parsers are able to reach an accuracy at the inter-annotator agreement level in the same-epoch-and-domain setup.
SemEval-2012 Task 5: Chinese Semantic Dependency Parsing

Wanxiang Che,Meishan Zhang,Yanqiu Shao,Ting Liu

DOI: https://doi.org/10.18653/v1/s16-1167

2012-01-01

Abstract:The paper presents the SemEval-2012 Shared Task 5: Chinese Semantic Dependency Parsing. The goal of this task is to identify the dependency structure of Chinese sentences from the semantic view. We firstly introduce the motivation of providing Chinese semantic dependency parsing task, and then describe the task in detail including data preparation, data format, task evaluation, and so on. Over ten thousand sentences were labeled for participants to train and evaluate their systems. At last, we briefly describe the submitted systems and analyze these results.
Chinese Dependency Parsing Based on Treebank

刘海涛,赵怿怡

DOI: https://doi.org/10.3969/j.issn.1003-6059.2009.01.003

2009-01-01

Pattern Recognition and Artificial Intelligence

Abstract:Aiming at exploring the possibility of increasing the parsing accuracy by linguistic means,an experiment of Chinese dependency parsing is conducted by using MaltParser and a self-built treebank.Through the detailed analysis for the parsing results,the possible suggestion about improving the performance of the parser is provided and it is used as the guidance to modify the annotation scheme of the treebank.Experimental results show that the accuracy of unlabeled dependency attachment score increases 5.5%,and the accuracy of labeled score raises 7.5%.
Universal Discourse Representation Structure Parsing

Jiangming Liu,Shay B. Cohen,Mirella Lapata,Johan Bos

DOI: https://doi.org/10.1162/coli_a_00406

IF: 7.778

2021-05-20

Computational Linguistics

Abstract:Abstract We consider the task of crosslingual semantic parsing in the style of Discourse Representation Theory (DRT) where knowledge from annotated corpora in a resource-rich language is transferred via bitext to guide learning in other languages. We introduce Universal Discourse Representation Theory (UDRT), a variant of DRT that explicitly anchors semantic representations to tokens in the linguistic input. We develop a semantic parsing framework based on the Transformer architecture and utilize it to obtain semantic resources in multiple languages following two learning schemes. The Many-to-One approach translates non-English text to English, and then runs a relatively accurate English parser on the translated text, while the One-to-Many approach translates gold standard English to non-English text and trains multiple parsers (one per language) on the translations. Experimental results on the Parallel Meaning Bank show that our proposal outperforms strong baselines by a wide margin and can be used to construct (silver-standard) meaning banks for 99 languages.

computer science, artificial intelligence, interdisciplinary applications,linguistics
High-order Joint Constituency and Dependency Parsing

Yanggan Gu,Yang Hou,Zhefeng Wang,Xinyu Duan,Zhenghua Li

2024-03-26

Abstract:This work revisits the topic of jointly parsing constituency and dependency trees, i.e., to produce compatible constituency and dependency trees simultaneously for input sentences, which is attractive considering that the two types of trees are complementary in representing syntax. The original work of Zhou and Zhao (2019) performs joint parsing only at the inference phase. They train two separate parsers under the multi-task learning framework (i.e., one shared encoder and two independent decoders). They design an ad-hoc dynamic programming-based decoding algorithm of $O(n^5)$ time complexity for finding optimal compatible tree pairs. Compared to their work, we make progress in three aspects: (1) adopting a much more efficient decoding algorithm of $O(n^4)$ time complexity, (2) exploring joint modeling at the training phase, instead of only at the inference phase, (3) proposing high-order scoring components to promote constituent-dependency interaction. We conduct experiments and analysis on seven languages, covering both rich-resource and low-resource scenarios. Results and analysis show that joint modeling leads to a modest overall performance boost over separate modeling, but substantially improves the complete matching ratio of whole trees, thanks to the explicit modeling of tree compatibility.

Computation and Language
Transition-Based Parsing for Deep Dependency Structures.

Xun Zhang,Yantao Du,Weiwei Sun,Xiaojun Wan

DOI: https://doi.org/10.1162/coli_a_00252

IF: 7.778

2016-01-01

Computational Linguistics

Abstract:Derivations under different grammar formalisms allow extraction of various dependency structures. Particularly, bilexical deep dependency structures beyond surface tree representation can be derived from linguistic analysis grounded by CCG, LFG, and HPSG. Traditionally, these dependency structures are obtained as a by-product of grammar-guided parsers. In this article, we study the alternative data-driven, transition-based approach, which has achieved great success for tree parsing, to build general dependency graphs. We integrate existing tree parsing techniques and present two new transition systems that can generate arbitrary directed graphs in an incremental manner. Statistical parsers that are competitive in both accuracy and efficiency can be built upon these transition systems. Furthermore, the heterogeneous design of transition systems yields diversity of the corresponding parsing models and thus greatly benefits parser ensemble. Concerning the disambiguation problem, we introduce two new techniques, namely, transition combination and tree approximation, to improve parsing quality. Transition combination makes every action performed by a parser significantly change configurations. Therefore, more distinct features can be extracted for statistical disambiguation. With the same goal of extracting informative features, tree approximation induces tree backbones from dependency graphs and re-uses tree parsing techniques to produce tree-related features. We conduct experiments on CCG-grounded functor–argument analysis, LFG-grounded grammatical relation analysis, and HPSG-grounded semantic dependency analysis for English and Chinese. Experiments demonstrate that data-driven models with appropriate transition systems can produce high-quality deep dependency analysis, comparable to more complex grammar-driven models. Experiments also indicate the effectiveness of the heterogeneous design of transition systems for parser ensemble, transition combination, as well as tree approximation for statistical disambiguation.
Cross-lingual Dependency Parsing Based on Distributed Representations.

Jiang Guo,Wanxiang Che,David Yarowsky,Haifeng Wang,Ting Liu

DOI: https://doi.org/10.3115/v1/p15-1119

2015-01-01

Abstract:This paper investigates the problem of cross-lingual dependency parsing, aiming at inducing dependency parsers for low-resource languages while using only training data from a resource-rich language (e.g. English). Existing approaches typically don’t include lexical features, which are not transferable across languages. In this paper, we bridge the lexical feature gap by using distributed feature representations and their composition. We provide two algorithms for inducing cross-lingual distributed representations of words, which map vocabularies from two different languages into a common vector space. Consequently, both lexical features and non-lexical features can be used in our model for cross-lingual transfer. Furthermore, our framework is able to incorporate additional useful features such as cross-lingual word clusters. Our combined contributions achieve an average relative error reduction of 10.9% in labeled attachment score as compared with the delexicalized parser, trained on English universal treebank and transferred to three other languages. It also significantly outperforms McDonald et al. (2013) augmented with projected cluster features on identical data.
Dependency Graph Based Chinese Semantic Parsing

Yu Ding,Yanqiu Shao,Wanxiang Che,Ting Liu

DOI: https://doi.org/10.1007/978-3-319-12277-9_6

2014-01-01

Abstract:Semantic Dependency Parsing (SDP) is a deep semantic analysis task. A well-formed dependency scheme is the foundation of SDP. In this paper, we refine the HIT dependency scheme using stronger linguistic theories, yielding a dependency scheme with more clear hierarchy. To cover Chinese semantics more comprehensively, we make a break away from the constraints of dependency trees, and extend to graphs. Moreover, we utilize SVM to parse semantic dependency graphs on the basis of parsing of dependency trees.
Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm

Hexuan Deng,Xin Zhang,Meishan Zhang,Xuebo Liu,Min Zhang

2023-07-25

Abstract:In this paper, we conduct a holistic exploration of the Universal Decompositional Semantic (UDS) Parsing. We first introduce a cascade model for UDS parsing that decomposes the complex parsing task into semantically appropriate subtasks. Our approach outperforms the prior models, while significantly reducing inference time. We also incorporate syntactic information and further optimized the architecture. Besides, different ways for data augmentation are explored, which further improve the UDS Parsing. Lastly, we conduct experiments to investigate the efficacy of ChatGPT in handling the UDS task, revealing that it excels in attribute parsing but struggles in relation parsing, and using ChatGPT for data augmentation yields suboptimal results. Our code is available at <a class="link-external link-https" href="https://github.com/hexuandeng/HExp4UDS" rel="external noopener nofollow">this https URL</a>.

Computation and Language
Enhancing Discourse Dependency Parsing with Sentence Dependency Parsing: A Unified Generative Method Based on Code Representation

Zizhuo Shen,Yanqiu Shao,Wei Li

DOI: https://doi.org/10.18653/v1/2024.findings-emnlp.729

2024-01-01

Abstract:Due to the high complexity of Discourse Dependency Parsing (DDP) tasks, their existing annotation resources are relatively scarce compared to other NLP tasks, and different DDP tasks also have significant differences in annotation schema. These issues have led to the dilemma of low resources for DDP tasks. Thanks to the powerful capabilities of Large Language Models (LLMs) in cross-task learning, we can use LLMs to model dependency parsing under different annotation schema in an unified manner, in order to alleviate the dilemma of low resources for DDP tasks. However, enabling LLMs to deeply comprehend dependency parsing tasks is a challenge that remains underexplored. Inspired by the application of code-based methods in complex tasks, we propose a code-based unified dependency parsing method. We treat the process of dependency parsing as a search process of dependency paths and use code to represent this search process. Furthermore, we use a curriculum-learning based instruction tuning strategy for joint training of multiple dependency parsing tasks. The experimental results show that our proposed code-based DDP system has achieved good performance on two Chinese DDP tasks (especially significant improvement on the DDP task with relatively less training data).

The HIT-SCIR System for End-to-End Parsing of Universal Dependencies

Universal Dependencies Parsing For Colloquial Singaporean English

Enhanced Universal Dependency Parsing with Automated Concatenation of Embeddings

A Universal Framework for Inductive Transfer Parsing Across Multi-typed Treebanks.

A Simple Yet Effective Joint Training Method for Cross-Lingual Universal Dependency Parsing.

Exploiting Multi-typed Treebanks for Parsing with Deep Multi-task Learning.

Enhanced Universal Dependency Parsing with Second-Order Inference and Mixture of Training Data

Overview of the NLPCC 2019 Shared Task: Cross-Domain Dependency Parsing

NJU-Parser: Achievements on Semantic Dependency Parsing.

Peking: Building Semantic Dependency Graphs with a Hybrid Parser.

The Status of Function Words in Dependency Grammar: A Critique of Universal Dependencies (UD)

Peking at MRP 2019: Factorization- and Composition-Based Parsing for Elementary Dependency Structures

SemEval-2012 Task 5: Chinese Semantic Dependency Parsing

Chinese Dependency Parsing Based on Treebank

Universal Discourse Representation Structure Parsing

High-order Joint Constituency and Dependency Parsing

Transition-Based Parsing for Deep Dependency Structures.

Cross-lingual Dependency Parsing Based on Distributed Representations.

Dependency Graph Based Chinese Semantic Parsing

Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm

Enhancing Discourse Dependency Parsing with Sentence Dependency Parsing: A Unified Generative Method Based on Code Representation