Validation of severity scoring systems SAPS II and APACHE II in a single-center population

M. Capuzzo,V. Valpondi,A. Sgarbi,S. Bortolazzi,V. Pavoni,G. Gilli,G. Candini,G. Gritti,R. Alvisi

DOI: https://doi.org/10.1007/s001340000715

IF: 38.9

2000-10-19

Intensive Care Medicine

Abstract:

What problem does this paper attempt to address?

Dependency Parsing with Partial Annotations: an Empirical Comparison.

Yue Zhang,Zhenghua Li,Jun Lang,Qingrong Xia,Min Zhang

2017-01-01

Abstract:This paper describes and compares two straightforward approaches for dependency parsing with partial annotations (PA). The first approach is based on a forest-based training objective for two CRF parsers, i.e., a biaffine neural network graph-based parser (Biaffine) and a traditional log-linear graph-based parser (LLGPar). The second approach is based on the idea of constrained decoding for three parsers, i.e., a traditional linear graph-based parser (LGPar), a globally normalized neural network transition-based parser (GN3Par) and a traditional linear transition-based parser (LTPar). For the test phase, constrained decoding is also used for completing partial trees. We conduct experiments on Penn Treebank under three different settings for simulating PA, i.e., random, most uncertain, and divergent outputs from the five parsers. The results show that LLGPar is most effective in directly learning from PA, and other parsers can achieve best performance when PAs are completed into full trees by LLGPar.
Data-driven, PCFG-based and Pseudo-PCFG-based Models for Chinese Dependency Parsing

Weiwei Sun,Xiaojun Wan

DOI: https://doi.org/10.1162/tacl_a_00229

IF: 10.9

2013-01-01

Transactions of the Association for Computational Linguistics

Abstract:We present a comparative study of transition-, graph- and PCFG-based models aimed at illuminating more precisely the likely contribution of CFGs in improving Chinese dependency parsing accuracy, especially by combining heterogeneous models. Inspired by the impact of a constituency grammar on dependency parsing, we propose several strategies to acquire pseudo CFGs only from dependency annotations. Compared to linguistic grammars learned from rich phrase-structure treebanks, well designed pseudo grammars achieve similar parsing accuracy and have equivalent contributions to parser ensemble. Moreover, pseudo grammars increase the diversity of base models; therefore, together with all other models, further improve system combination. Based on automatic POS tagging, our final model achieves a UAS of 87.23%, resulting in a significant improvement of the state of the art.
A Neural Probabilistic Structured-Prediction Model for Transition-Based Dependency Parsing.

Hao Zhou,Yue Zhang,Shujian Huang,Jiajun Chen

DOI: https://doi.org/10.3115/v1/p15-1117

2015-01-01

Abstract:Neural probabilistic parsers are attractive for their capability of automatic feature combination and small data sizes. A transition-based greedy neural parser has given better accuracies over its linear counterpart. We propose a neural probabilistic structured-prediction model for transition-based dependency parsing, which integrates search and learning. Beam search is used for decoding, and contrastive learning is performed for maximizing the sentence-level log-likelihood. In standard Penn Treebank experiments, the structured neural parser achieves a 1.8% accuracy improvement upon a competitive greedy neural parser baseline, giving performance comparable to the best linear parser.
Jointly or Separately: Which is Better for Parsing Heterogeneous Dependencies?

Meishan Zhang,Wanxiang Che,Yanqiu Shao,Ting Liu

2014-01-01

Abstract:For languages such as English, several constituent-to-dependency conversion schemes are proposed to construct corpora for dependency parsing. It is hard to determine which scheme is better because they reflect different views of dependency analysis. We usually obtain dependency parsers of different schemes by training with the specific corpus separately. It neglects the correlations between these schemes, which can potentially benefit the parsers. In this paper, we study how these correlations influence final dependency parsing performances, by proposing a joint model which can make full use of the correlations between heterogeneous dependencies, and finally we can answer the following question: parsing heterogeneous dependencies jointly or separately, which is better? We conduct experiments with two different schemes on the Penn Treebank and the Chinese Penn Treebank respectively, arriving at the same conclusion that jointly parsing heterogeneous dependencies can give improved performances for both schemes over the individual models.
Statistical Decision-Tree Models for Parsing

David M. Magerman

DOI: https://doi.org/10.48550/arXiv.cmp-lg/9504030

1995-04-29

Computation and Language

Abstract:Syntactic natural language parsers have shown themselves to be inadequate for processing highly-ambiguous large-vocabulary text, as is evidenced by their poor performance on domains like the Wall Street Journal, and by the movement away from parsing-based approaches to text-processing in general. In this paper, I describe SPATTER, a statistical parser based on decision-tree learning techniques which constructs a complete parse for every sentence and achieves accuracy rates far better than any published result. This work is based on the following premises: (1) grammars are too complex and detailed to develop manually for most interesting domains; (2) parsing models must rely heavily on lexical and contextual information to analyze sentences accurately; and (3) existing {$n$}-gram modeling techniques are inadequate for parsing models. In experiments comparing SPATTER with IBM's computer manuals parser, SPATTER significantly outperforms the grammar-based parser. Evaluating SPATTER against the Penn Treebank Wall Street Journal corpus using the PARSEVAL measures, SPATTER achieves 86\% precision, 86\% recall, and 1.3 crossing brackets per sentence for sentences of 40 words or less, and 91\% precision, 90\% recall, and 0.5 crossing brackets for sentences between 10 and 20 words in length.
Theoretical probability of dependency structural trees

Fengguo Hu,Wenwen Li,Haitao Liu

DOI: https://doi.org/10.1109/NLPKE.2011.6138165

2011-01-01

Abstract:Dependency structural tree is widely used in the research of dependency grammar and parsing, and it is one of the important forms of the syntactic structure of natural language. The research of the theoretical forms and their probabilities are of great importance to probability-based disambiguation of parsing. In this paper we propose the formula and its algorithm to calculate the probability of any well-formed dependency structural tree.
Monte Carlo Syntax Marginals for Exploring and Using Dependency Parses

Katherine A. Keith,Su Lin Blodgett,Brendan O'Connor

DOI: https://doi.org/10.48550/arXiv.1804.06004

2018-04-17

Abstract:Dependency parsing research, which has made significant gains in recent years, typically focuses on improving the accuracy of single-tree predictions. However, ambiguity is inherent to natural language syntax, and communicating such ambiguity is important for error analysis and better-informed downstream applications. In this work, we propose a transition sampling algorithm to sample from the full joint distribution of parse trees defined by a transition-based parsing model, and demonstrate the use of the samples in probabilistic dependency analysis. First, we define the new task of dependency path prediction, inferring syntactic substructures over part of a sentence, and provide the first analysis of performance on this task. Second, we demonstrate the usefulness of our Monte Carlo syntax marginal method for parser error analysis and calibration. Finally, we use this method to propagate parse uncertainty to two downstream information extraction applications: identifying persons killed by police and semantic role assignment.

Computation and Language
Transition-Based Parsing for Deep Dependency Structures.

Xun Zhang,Yantao Du,Weiwei Sun,Xiaojun Wan

DOI: https://doi.org/10.1162/coli_a_00252

IF: 7.778

2016-01-01

Computational Linguistics

Abstract:Derivations under different grammar formalisms allow extraction of various dependency structures. Particularly, bilexical deep dependency structures beyond surface tree representation can be derived from linguistic analysis grounded by CCG, LFG, and HPSG. Traditionally, these dependency structures are obtained as a by-product of grammar-guided parsers. In this article, we study the alternative data-driven, transition-based approach, which has achieved great success for tree parsing, to build general dependency graphs. We integrate existing tree parsing techniques and present two new transition systems that can generate arbitrary directed graphs in an incremental manner. Statistical parsers that are competitive in both accuracy and efficiency can be built upon these transition systems. Furthermore, the heterogeneous design of transition systems yields diversity of the corresponding parsing models and thus greatly benefits parser ensemble. Concerning the disambiguation problem, we introduce two new techniques, namely, transition combination and tree approximation, to improve parsing quality. Transition combination makes every action performed by a parser significantly change configurations. Therefore, more distinct features can be extracted for statistical disambiguation. With the same goal of extracting informative features, tree approximation induces tree backbones from dependency graphs and re-uses tree parsing techniques to produce tree-related features. We conduct experiments on CCG-grounded functor–argument analysis, LFG-grounded grammatical relation analysis, and HPSG-grounded semantic dependency analysis for English and Chinese. Experiments demonstrate that data-driven models with appropriate transition systems can produce high-quality deep dependency analysis, comparable to more complex grammar-driven models. Experiments also indicate the effectiveness of the heterogeneous design of transition systems for parser ensemble, transition combination, as well as tree approximation for statistical disambiguation.
Learning latent variable grammars from complementary perspectives

Dongchen Li,Xiantao Zhang,Xihong Wu

DOI: https://doi.org/10.1109/ChinaSIP.2014.6889215

2014-01-01

Abstract:The corpus for training a parser consists of sentences of heterogeneous grammar usages. Previous parser domain adaptation work has concentrated on adaptation to the shifts in vocabulary rather than grammar usage. In this paper, we focus on exploiting the diversity of training date separately and then accumulates their advantages. We propose an approach that grammar is biased toward relevant syntactic style, and the complementary grammar usage are combined for inference. Multiple grammars with partly complementary points of strength are induced individually. They capture complementary data representation, and we accumulates their advantages in a joint model to assemble the complementary depicting powers. Despite its compatibility with many other methods, out product model achieves 85.20% F1 score on Penn Chinese Treebank, higher than previous systems.
Chinese Dependency Parsing Based on Treebank

刘海涛,赵怿怡

DOI: https://doi.org/10.3969/j.issn.1003-6059.2009.01.003

2009-01-01

Pattern Recognition and Artificial Intelligence

Abstract:Aiming at exploring the possibility of increasing the parsing accuracy by linguistic means,an experiment of Chinese dependency parsing is conducted by using MaltParser and a self-built treebank.Through the detailed analysis for the parsing results,the possible suggestion about improving the performance of the parser is provided and it is used as the guidance to modify the annotation scheme of the treebank.Experimental results show that the accuracy of unlabeled dependency attachment score increases 5.5%,and the accuracy of labeled score raises 7.5%.
Interrelations Among Dependency Tree Widths, Heights And Sentence Lengths

Hongxin Zhang,Haitao Liu

DOI: https://doi.org/10.1515/9783110573565-002

2018-01-01

Abstract:This paper chooses two news-genre dependency treebanks, one in Chinese and one in English and examines the synergetics or the interrelations among dependency tree widths, heights and sentence lengths in the framework of dependency grammar. When sentences grow longer, the dependency trees grow both taller and higher. The growths of heights and widths are competing with each other, resulting in a minimization of dependency distance. The product of the widest layer and its width corresponds to the sentence length. These correlations are integrated into a tentative synergetic syntactic model based on the framework of dependency grammar.
A Semi-Autoregressive Graph Generative Model for Dependency Graph Parsing

Ye Ma,Mingming Sun,Ping Li

2023-06-21

Abstract:Recent years have witnessed the impressive progress in Neural Dependency Parsing. According to the different factorization approaches to the graph joint probabilities, existing parsers can be roughly divided into autoregressive and non-autoregressive patterns. The former means that the graph should be factorized into multiple sequentially dependent components, then it can be built up component by component. And the latter assumes these components to be independent so that they can be outputted in a one-shot manner. However, when treating the directed edge as an explicit dependency relationship, we discover that there is a mixture of independent and interdependent components in the dependency graph, signifying that both aforementioned models fail to precisely capture the explicit dependencies among nodes and edges. Based on this property, we design a Semi-Autoregressive Dependency Parser to generate dependency graphs via adding node groups and edge groups autoregressively while pouring out all group elements in parallel. The model gains a trade-off between non-autoregression and autoregression, which respectively suffer from the lack of target inter-dependencies and the uncertainty of graph generation orders. The experiments show the proposed parser outperforms strong baselines on Enhanced Universal Dependencies of multiple languages, especially achieving $4\%$ average promotion at graph-level accuracy. Also, the performances of model variations show the importance of specific parts.

Computation and Language,Artificial Intelligence
Probability Distribution of Dependencies Based on A Chinese Dependency Treebank

Haitao Liu

DOI: https://doi.org/10.1080/09296170902975742

2009-01-01

Journal of Quantitative Linguistics

Abstract:This article investigates probability distributions of the dependency relation extracted from a Chinese dependency treebank. The author shows the frequency distributions of dependency type, of word class both as a dependent and a governor, of verb as a governor, and of noun as a dependent. The fitting results reveal that most of the investigated distributions are excellently fitted with a modified right-truncated Zipf-Alekseev distribution. In the analysis of exponential regressions, most of the determination coefficients R-2 are very good, which is an alternative evidence that the investigated distributions are fitted well.
Exploiting limited data for parsing

Dongchen Li,Xiantao Zhang,Xihong Wu

DOI: https://doi.org/10.1109/ICIS.2014.6912128

2014-01-01

Abstract:Data sparsity issues are extremely severe for parser due to the flexibility of tree structures. Many tags and productions appears a little, nevertheless, they are crucial for the parse disambiguation where it occurs. Besides, when a common tag somewhat regularly occurs in a non-canonical position, its distribution is usually distinct. In this paper, we propose a metric that measures the scarcity of any phrase with arbitrary span size. To make a better compromise between training trees with high confidence and scarcity, we try to catch some constraints in response to rare but articulating categories when training latent variable grammar. We exploits the limited data more sufficiently by capturing the depicting power of rate tree structure configuration in Expectation & Maximization procedure and Split & Merge framework. The resulting grammars are interpretable as our intension. Based on this approach, we further propose a method that exploits the limited training date from multiple perspectives, and accumulates their advantages in a product model. Despite its limited training data, out model improves parsing performance on Penn Chinese Treebank Fifth Edition, even higher than some systems with extra unlabeled data and external resources. Furthermore, this method is easy to generalized to cope with data sparsity in other natural language processing tasks.
Peking at EPE 2017: A comparison of tree approximation, transition-based, and maximum subgraph models for semantic dependency analysis

Yufei Chen,Junjie Cao,Weiwei Sun,Xiaojun Wan

2017-01-01

Abstract:This paper is a description of our system for EPE 2017: Extrinsic Parser Evaluation. We are concerned with three different models, namely tree approximation, transition-based and Maximum Subgraph models for semantic dependency parsing. We present a preliminary comparison of these models by showing some intrinsic and extrinsic evaluation results.
Empirical Analysis for Unsupervised Universal Dependency Parse Tree Aggregation

Adithya Kulkarni,Oliver Eulenstein,Qi Li

2024-04-03

Abstract:Dependency parsing is an essential task in NLP, and the quality of dependency parsers is crucial for many downstream tasks. Parsers' quality often varies depending on the domain and the language involved. Therefore, it is essential to combat the issue of varying quality to achieve stable performance. In various NLP tasks, aggregation methods are used for post-processing aggregation and have been shown to combat the issue of varying quality. However, aggregation methods for post-processing aggregation have not been sufficiently studied in dependency parsing tasks. In an extensive empirical study, we compare different unsupervised post-processing aggregation methods to identify the most suitable dependency tree structure aggregation method.

Computation and Language
A Quantitative Analysis of English Variants Based on Dependency Treebanks

Guoqiang Zhang,Haitao Liu

2019-01-01

Glottometrics

Abstract:Different English variants have been found to have different characteristics with respect to the aspects of pronunciation, vocabulary, spelling, and grammar, but there is a dearth of research from the perspective of sentence length and syntactic dependency. Therefore, the present research studies these two aspects based on 12 self-building academic dependency treebanks and finds that: (1) in terms of sentence length and syntactic dependency, different variants of English manifest great similarities; (2) regarding the distribution of dependency distance of English variants, the parameters of right-truncated modified Zipf-Alekseev model can provide evidence for the different stages of English globalization; (3) in addition, their syntactic dependencies are little affected by their respective native languages, suggesting the important roles of grammar and cognition in the syntactic constraint. The present research provides a new perspective to study English variants, and its conclusion is hopefully expected to enrich the current research theory.
Universal Dependencies Parsing For Colloquial Singaporean English

Hongmin Wang,Yue Zhang,GuangYong Leonard Chan,Jie Yang,Hai Leong Chieu

DOI: https://doi.org/10.18653/v1/P17-1159

2017-01-01

Abstract:Singlish can be interesting to the ACL community both linguistically as a major creole based on English, and computationally for information extraction and sentiment analysis of regional social media. We investigate dependency parsing of Singlish by constructing a dependency treebank under the Universal Dependencies scheme, and then training a neural network model by integrating English syntactic knowledge into a state-of-the-art parser trained on the Singlish treebank. Results show that English knowledge can lead to 25% relative error reduction, resulting in a parser of 84.47% accuracies. To the best of our knowledge, we are the first to use neural stacking to improve cross-lingual dependency parsing on low-resource languages. We make both our annotation and parser available for further research.
An empirical study for Vietnamese dependency parsing

Dat Quoc Nguyen,Mark Dras,Mark Johnson

DOI: https://doi.org/10.48550/arXiv.1611.00995

2016-11-03

Abstract:This paper presents an empirical comparison of different dependency parsers for Vietnamese, which has some unusual characteristics such as copula drop and verb serialization. Experimental results show that the neural network-based parsers perform significantly better than the traditional parsers. We report the highest parsing scores published to date for Vietnamese with the labeled attachment score (LAS) at 73.53% and the unlabeled attachment score (UAS) at 80.66%.

Computation and Language
High-order Joint Constituency and Dependency Parsing

Yanggan Gu,Yang Hou,Zhefeng Wang,Xinyu Duan,Zhenghua Li

2024-03-26

Abstract:This work revisits the topic of jointly parsing constituency and dependency trees, i.e., to produce compatible constituency and dependency trees simultaneously for input sentences, which is attractive considering that the two types of trees are complementary in representing syntax. The original work of Zhou and Zhao (2019) performs joint parsing only at the inference phase. They train two separate parsers under the multi-task learning framework (i.e., one shared encoder and two independent decoders). They design an ad-hoc dynamic programming-based decoding algorithm of $O(n^5)$ time complexity for finding optimal compatible tree pairs. Compared to their work, we make progress in three aspects: (1) adopting a much more efficient decoding algorithm of $O(n^4)$ time complexity, (2) exploring joint modeling at the training phase, instead of only at the inference phase, (3) proposing high-order scoring components to promote constituent-dependency interaction. We conduct experiments and analysis on seven languages, covering both rich-resource and low-resource scenarios. Results and analysis show that joint modeling leads to a modest overall performance boost over separate modeling, but substantially improves the complete matching ratio of whole trees, thanks to the explicit modeling of tree compatibility.

Computation and Language

Validation of severity scoring systems SAPS II and APACHE II in a single-center population

Dependency Parsing with Partial Annotations: an Empirical Comparison.

Data-driven, PCFG-based and Pseudo-PCFG-based Models for Chinese Dependency Parsing

A Neural Probabilistic Structured-Prediction Model for Transition-Based Dependency Parsing.

Jointly or Separately: Which is Better for Parsing Heterogeneous Dependencies?

Statistical Decision-Tree Models for Parsing

Theoretical probability of dependency structural trees

Monte Carlo Syntax Marginals for Exploring and Using Dependency Parses

Transition-Based Parsing for Deep Dependency Structures.

Learning latent variable grammars from complementary perspectives

Chinese Dependency Parsing Based on Treebank

Interrelations Among Dependency Tree Widths, Heights And Sentence Lengths

A Semi-Autoregressive Graph Generative Model for Dependency Graph Parsing

Probability Distribution of Dependencies Based on A Chinese Dependency Treebank

Exploiting limited data for parsing

Peking at EPE 2017: A comparison of tree approximation, transition-based, and maximum subgraph models for semantic dependency analysis

Empirical Analysis for Unsupervised Universal Dependency Parse Tree Aggregation

A Quantitative Analysis of English Variants Based on Dependency Treebanks

Universal Dependencies Parsing For Colloquial Singaporean English

An empirical study for Vietnamese dependency parsing

High-order Joint Constituency and Dependency Parsing