Towards a theory of word order. Comment on "Dependency distance: a new perspective on syntactic patterns in natural language" by Haitao Liu et al

Ramon Ferrer-i-Cancho

DOI: https://doi.org/10.48550/arXiv.1706.04872

2017-06-15

Computation and Language

Abstract:Comment on "Dependency distance: a new perspective on syntactic patterns in natural language" by Haitao Liu et al

What problem does this paper attempt to address?

DDM at Work: Reply to comments on “Dependency distance: A new perspective on syntactic patterns in natural languages”

Chunshan Xu,Junying Liang,Haitao Liu

DOI: https://doi.org/10.1016/j.plrev.2017.07.001

IF: 9.833

2017-01-01

Physics of Life Reviews

Abstract:We provide responses to the commentaries in this volume to evaluate, clarify and extend some of the arguments in Dependency distance: A new perspective on syntactic patterns in natural languages. Evidences show that DDM (dependency distance minimization) is an important linguistic universal, biologically or cognitively motivated, in shaping the language system. As a general tendency, DDM works quite well in theoretical argumentations as well as practical applications. However, this does not mean that DDM is the only linguistic universal that works: it is highly possible that other factors, which might be biologically, physically, socially or culturally motivated, work as well to jointly mold languages.
Dependency Distance: A New Perspective on Syntactic Patterns in Natural Languages.

Haitao Liu,Chunshan Xu,Junying Liang

DOI: https://doi.org/10.1016/j.plrev.2017.03.002

IF: 9.833

2017-01-01

Physics of Life Reviews

Abstract:Dependency distance, measured by the linear distance between two syntactically related words in a sentence, is generally held as an important index of memory burden and an indicator of syntactic difficulty. Since this constraint of memory is common for all human beings, there may well be a universal preference for dependency distance minimization (DDM) for the sake of reducing memory burden. This human-driven language universal is supported by big data analyses of various corpora that consistently report shorter overall dependency distance in natural languages than in artificial random languages and long-tailed distributions featuring a majority of short dependencies and a minority of long ones. Human languages, as complex systems, seem to have evolved to come up with diverse syntactic patterns under the universal pressure for dependency distance minimization. However, there always exist a small number of long-distance dependencies in natural languages, which may reflect some other biological or functional constraints. Language system may adapt itself to these sporadic long-distance dependencies. It is these universal constraints that have shaped such a rich diversity of syntactic patterns in human languages.
Dependency direction as a means of word-order typology: A method based on dependency treebanks

Haitao Liu

DOI: https://doi.org/10.1016/j.lingua.2009.10.001

IF: 0.916

2010-01-01

Lingua

Abstract:Word-order typology often uses the linear order of binary grammatical pairs in sentences to classify a language. The present paper proposes a method based on dependency treebanks as a typological means. This paper investigates 20 languages using treebanks with different sizes from 16K to 1 million dependencies. The results show that some languages are more head-initial or head-final than others, but all contain head-initial and head-final elements. The 20 languages can be arranged on a continuum with complete head-initial and head-final patterns as the two ends. Some data about subject–verb, object–verb and adjective–noun are extracted from the treebanks for comparison with the typological studies based on the traditional means, the results are similar. The investigation demonstrates that the proposed method is valid for positioning a language in the typological continuum and the resources from computational linguistics can also be used in language typology.
Effects of Syntactic Distance and Word Order on Language Processing: an Investigation Based on a Psycholinguistic Treebank of English

Niu Ruochen,Liu Haitao

DOI: https://doi.org/10.1007/s10936-022-09878-4

2022-01-01

Journal of Psycholinguistic Research

Abstract:We conducted a broad-coverage investigation of the effects of syntactic distance and word order on language processing against a dependency-annotated reading time corpus of English. A combined method of quantitative syntax and psycholinguistic analyses was adopted to yield converging evidence. It was found that (i) head-initial structures allow greater structural complexity, i.e., larger head-dependent distance, than head-final structures in both language comprehension and production; (ii) within the capacity limit of working memory, syntactic distance is a positive predictor of reading time for a word with a preceding head, whereas a negative predictor of reading time for a word with a following head; and (iii) at the sentence level, syntactic distance is a significant predictor of sentence reading time. These results suggest that (i) different word orders may enjoy different processing mechanisms in terms of cognitive difficulty and processes, which can be explained by an incremental language parser; and (ii) in addition to distance, word order should also be considered as a factor affecting language processing, which is an important extension to distance-based language processing models. Taken as a whole, our study paves the way for corpus-based integration of quantitative linguistic and psycholinguistic methods into understanding language processing and its underlying cognitive mechanisms.
Dependency Distance As A Metric of Language Comprehension Difficulty

Haitao Liu

DOI: https://doi.org/10.17791/jcs.2008.9.2.159

2008-01-01

Abstract:Linguistic complexity is a measure of the cognitive difficulty of human language processing. The present paper proposes dependency distance, in the framework of dependency grammar, as an insightful metric of complexity. Three hypotheses are formulated: (1) The human language parser prefers linear orders that minimize the average dependency distance of the recognized sentence (2) There is a threshold that the average dependency distance of most sentences or texts of human languages does not exceed (3) Grammar and cognition combine to keep dependency distance within the threshold. Twenty corpora from different languages with dependency syntactic annotation are used to test these hypotheses. The paper reports the average dependency distance in these corpora and analyzes the factors which influence dependency distance. The findings - that average dependency distance has a tendency to be minimized in human language and that there is a threshold of less than 3 words in average dependency distance and grammar plays an important role in constraining distance - support all three hypotheses, although some questions are still open for further research.
What Factors Are Associated with Dependency Distances to Ensure Easy Comprehension? A Case Study of Ba Sentences in Mandarin Chinese

Yu Fang,Haitao Liu

DOI: https://doi.org/10.1016/j.langsci.2018.04.005

IF: 0.816

2018-01-01

Language Sciences

Abstract:Dependency distance, referring to the linear distance between two syntactically related words, is often minimized, because long-distance dependencies (LDDs) may cause processing difficulties. However, LDDs can be found in some sentences, for example, Chinese ba sentences, because besides LDDs, other factors also influence the comprehension difficulty. Based on ba sentences extracted from three genres: interviews, essays and research papers, this study investigated the impact of givenness, word frequencies and adverbial lengths on dependency distances. The results show that: 1) givenness of subjects and NP2s in ba sentences affects dependency distances in all three genres, and the effect is consistent among genres; 2) word frequencies of subjects in interviews also affect dependency distances, but such an impact has not been found in essays and research papers; 3) adverbial lengths and NP2 lengths do not counterbalance each other to limit dependency distances. These findings suggest that: 1) comprehension difficulty is influenced by multiple factors; 2) the impact of the three factors on dependency distances is not influenced by genres.
Chinese Syntactic and Typological Properties Based on Dependency Syntactic Treebanks

Haitao Liu,Yiyi Zhao,Wenwen Li

DOI: https://doi.org/10.2478/v10010-009-0025-3

2009-01-01

Poznan Studies in Contemporary Linguistics

Abstract:This paper offers a quantitative analysis of the syntactic and typological properties of Chinese based on five Chinese dependency treebanks. The study shows that mean dependency distance of Chinese is 2.84; 40-50% dependencies are between non-adjacent words; Chinese is a mixed language with a governor-final and SV-VO-AdjN preference; the mean dependency distance of governor-initial dependencies is greater than that of governor-final ones. Methodologically, the paper adopts five treebanks with different text genres and annotation schemes as a resource to study syntactic features of a language. This method avoids corpus influences on results so that the conclusions can be more reliable and robust. If suitable treebanks are available, it will be an easy task to apply our method to other languages. In this way, the method has a broad theoretical and cross-linguistic perspective.
Factors influencing dependency parsing of coordinating structure

Yiyi Zhao,Song Gao,Haitao Liu

DOI: https://doi.org/10.1109/NLPKE.2009.5313780

2009-01-01

Abstract:Coordinating structure is a special phenomena with high frequence in human languages. It enjoys a special status in linguistic theories especially in dependency grammars, which require the exceptional treatment. This paper proposes three schemes to analyse coordinating structure and builds dependency treebanks for automatic parsing. We find that different schemes to annotate and parse the coordinating structure bring some distinctions in precision and other aspects. The factors, such as the part-of-speech categories matching with their syntactic functions, may play an important role in dependency parsing. We also calculate the mean dependency distance of three schemes, and the result shows that single-directional and smaller mean dependency distance is helpful for better machine learning and higher precision.
The Role of Working Memory in Shaping Syntactic Dependency Structures

X. Cai,Haitao Liu

DOI: https://doi.org/10.1017/9781108955638.020

2022-01-01

Abstract:Dependency syntax holds that the goal of syntactic analysis is to establish all the binary relations between words in a sentence. This process is closely related to working memory. In a sentence, the words between two syntactically related words make for dependency distance, which is an index of sentence comprehension difficulty because, when the two syntactically related words are combined to each other in working memory, the first of them may suffer from memory decay or memory interference caused by the intervening words. Thus, working memory and the least effort principle may dictate a universal tendency for syntactic structures to be organized in such ways as to reduce dependency distance. This tendency has great shaping effect on the patterns of word order in human languages and is potentially able to account for many linguistic universals in language typology. As for the sporadic long dependency structures motivated by communicative needs, specific syntactic patterns may have evolved, utilizing some cognitive mechanisms to lessen the memory load of these long dependencies. Syntactic structures, therefore, are probably the result of self-adaption of a language system to certain external human constraints and motivations, among which working memory is a very important one.
The Status of Function Words in Dependency Grammar: A Critique of Universal Dependencies (UD)

Timothy Osborne,Kim Gerdes

DOI: https://doi.org/10.5334/gjgl.537

2019-01-01

Abstract:The article examines the Universal Dependencies (UD) annotation scheme. The UD project is an international initiative to produce treebanks of the world's languages, whereby the treebanks have been annotated in a cross-linguistically consistent manner. A central aspect of the UD annotation scheme is its analysis of function words. The scheme advocates subordinating function words to content words. This article discusses linguistic and practical motivations behind the UD decision to subordinate function words to content words. It demonstrates that UD choices in this area are not supported linguistically. At the same time, the near convertibility of the UD treebanks to a more linguistically motivated annotation format means that the UD initiative remains of great value to linguistics in general.
Dependency networks: A discussion note about Lamb’s theory of linguistic structure

Timothy Osborne

DOI: https://doi.org/10.31885/lud.4.1.231

2016-01-01

Language Under Discussion

Abstract:Sydney Lamb (2016) presents a theory of linguistic structure that reaches through all levels of linguistic organization (semantics, syntax, morphology, phonology). The network architecture of Lamb’s system is analogous to the network of neurons in the brain. Lamb’s theory organizes linguistic units in part in terms of constituencies. This discussion note explores the possibility of recasting Lamb’s theory entirely in terms of dependencies. An approach that relies more on dependency as the principle organizing the units of linguistic structure would result in simpler networks, increasing plausibility and thus being more consistent with the network of neurons in the brain.
Theoretical probability of dependency structural trees

Fengguo Hu,Wenwen Li,Haitao Liu

DOI: https://doi.org/10.1109/NLPKE.2011.6138165

2011-01-01

Abstract:Dependency structural tree is widely used in the research of dependency grammar and parsing, and it is one of the important forms of the syntactic structure of natural language. The research of the theoretical forms and their probabilities are of great importance to probability-based disambiguation of parsing. In this paper we propose the formula and its algorithm to calculate the probability of any well-formed dependency structural tree.
The Effects of Genre on Dependency Distance and Dependency Direction

Yaqin Wang,Haitao Liu

DOI: https://doi.org/10.1016/j.langsci.2016.09.006

IF: 0.816

2017-01-01

Language Sciences

Abstract:Dependency distance, the distance between words linked in a syntactic dependency, has been a key measure of interest in cross-linguistic corpus work, because it is hypothesized to reflect working memory demands during sentence processing. However, previous work has not systematically investigated the effects of text genre on dependency distance in English. We might expect spoken language to have shorter dependencies and informative technical language to have longer dependencies than do fiction and imaginative language. The current study uses quantitative methods to explore the distribution of dependency distance in English across genres controlled for sentence length. Ten genres of English from the British National Corpus provided the data source. The results show that 1) The distributions of dependency distances across all sentence lengths and genres follow the same parametric distributions. 2) Genre affects adjacent dependency rate significantly, but its effect is very small. 3) Sentence length and genre effect dependency distance significantly, but the effect is small. We find shorter dependencies in written-to-be-spoken texts, and longer dependencies in the imaginative genre than those in the informative genres. 4) Genre effects dependency direction significantly, but again the effect is small. Overall the results suggest that the effect of genre on these dependency measures is small, suggesting that dependency distance is primarily determined by universal cognitive factors rather than genre-specific stylistic factors.
The Influence of Chunking on Dependency Crossing and Distance

Qian Lu,Chunshan Xu,Haitao Liu

DOI: https://doi.org/10.1002/cplx.21779.

2015-01-01

Abstract:This paper hypothesizes that chunking plays important role in reducing dependency distance and dependency crossings. Computer simulations, when compared with natural languages,show that chunking reduces mean dependency distance (MDD) of a linear sequence of nodes (constrained by continuity or projectivity) to that of natural languages. More interestingly, chunking alone brings about less dependency crossings as well, though having failed to reduce them, to such rarity as found in human languages. These results suggest that chunking may play a vital role in the minimization of dependency distance, and a somewhat contributing role in the rarity of dependency crossing. In addition, the results point to a possibility that the rarity of dependency crossings is not a mere side-effect of minimization of dependency distance, but a linguistic phenomenon with its own motivations.
The Complexity of Chinese Syntactic Dependency Networks

Haitao Liu

DOI: https://doi.org/10.1016/j.physa.2008.01.069

2007-01-01

Abstract:This paper proposes how to build a syntactic network based on syntactic theory and presents some statistical properties of Chinese syntactic dependency networks based on two Chinese treebanks with different genres. The results show that the two syntactic networks are small-world networks, and their degree distributions obey a power law. The finding, that the two syntactic networks have the same diameter and different average degrees, path lengths, clustering coefficients and power exponents, can be seen as an indicator that complexity theory can work as a means of stylistic study. The paper links the degree of a vertex with a valency of a word, the small world with the minimized average distance of a language, that reinforces the explanations of the findings from linguistics.
Using A Chinese Treebank to Measure Dependency Distance

Haitao Liu,Richard Hudson,Zhiwei Feng

DOI: https://doi.org/10.1515/cllt.2009.007

2009-01-01

Corpus Linguistics and Linguistic Theory

Abstract:This article describes a method for calculating the 'dependency distance' between the words in a text - i.e. the number of words that separate each word from the word on which it depends syntactically - and reports the results of applying this method to a Chinese treebank. This study shows that Chinese dependencies tend strongly to be governor-final and that the mean dependency distance of words is much higher for Chinese than for other languages that have been studied including English, German and Japanese. It is unclear whether this difference means that Chinese is syntactically more difficult to process.
Dependency Length Minimization: Puzzles and Promises.

Haitao Liu,Chunshan Xu,Junying Liang

DOI: https://doi.org/10.48550/arxiv.1509.04393

2015-01-01

Abstract:In the recent issue of PNAS, Futrell et al. claims that their study of 37 languages gives the first large scale cross-language evidence for Dependency Length Minimization, which is an overstatement that ignores similar previous researches. In addition,this study seems to pay no attention to factors like the uniformity of genres,which weakens the validity of the argument that DLM is universal. Another problem is that this study sets the baseline random language as projective, which fails to truly uncover the difference between natural language and random language, since projectivity is an important feature of many natural languages. Finally, the paper contends an "apparent relationship between head finality and dependency length" despite the lack of an explicit statistical comparison, which renders this conclusion rather hasty and improper.
The effects of sentence length on dependency distance, dependency direction and the implications–Based on a parallel English–Chinese dependency treebank

jingyang jiang,haitao liu

DOI: https://doi.org/10.1016/j.langsci.2015.04.002

IF: 0.816

2015-01-01

Language Sciences

Abstract:Dependency distance is closely related to human working memory capacity, but is also influenced by other non-cognitive factors. Studies of dependency distance contribute to the understanding of the universalities and peculiarities of languages as well as human cognitive processes in language. Forty two sentence sets were selected from a parallel English–Chinese dependency treebank to examine the progressive properties of dependency distance with the change of sentence length in the two languages. It was found that: (1) the probability distribution models of dependency distance of both languages are not affected by either sentence length or the type of language; (2) the quantity of adjacent dependencies in the two languages are identical, but the quantity of adjacent dependencies of Chinese fluctuates within a limited range, while that of English shows a falling tendency; (3) the mean dependency distances (MDDs) of Chinese are always higher than those of English, and both MDDs show slight ascending trends; (4) compared with dependency distance, dependency direction is a more reliable metric for language classification. These findings suggest that: (1) the universal cognition mechanism may be the major factor affecting the general traits of dependency distance, while language-related factors such as sentence length may affect certain traits of dependency distance; and (2) Chinese taxes working memory more than English.
Revisiting English Written VP-ellipsis and VP-substitution: a Dependency-Based Analysis

Zheyuan Dai,Haitao Liu,Jianwei Yan

DOI: https://doi.org/10.1515/lingvan-2022-0088

2024-01-01

Linguistics Vanguard

Abstract:The present study quantitatively investigates the structural features of English written VP-ellipsis (VPE) and VP-substitution (VPS) under the theoretical framework of dependency grammar. Results show that: (a) Both VPE and VPS are human language mechanisms that follow the least effort principle; (b) Dependency distance of segmental and discontinuous linguistic units under the influence of VPE and VPS conform to the right-truncated Zipf-Alekseev distribution; (c) Dependency-based indices are effective in distinguishing similar structures of VPE and VPS, especially the Do-Support in ellipsis and Do + X in substitution. The study not only explores the regularity of partial segments of human language under the mechanisms of VPE and VPS, but also offers quantitative evidence for distinguishing confusing structures in VPE and VPS, which may aid in raising the retrieving precision of similar linguistic structures in corpora.
A Chinese Dependency Syntax for Treebanking

Haitao Liu,Wei Huang

2006-01-01

Abstract:This paper presents a Chinese dependency syntax for treebanking. The syntax contains 13 word classes and 34 dependency types. A format of treebank based on the syntax is also proposed for the applications of computational and general linguistic research. Some experiments show that the treebank based on the proposed dependency syntax can be used for training and evaluating the dependency parser and for quantitative analysis of Chinese syntax.

Towards a theory of word order. Comment on "Dependency distance: a new perspective on syntactic patterns in natural language" by Haitao Liu et al

DDM at Work: Reply to comments on “Dependency distance: A new perspective on syntactic patterns in natural languages”

Dependency Distance: A New Perspective on Syntactic Patterns in Natural Languages.

Dependency direction as a means of word-order typology: A method based on dependency treebanks

Effects of Syntactic Distance and Word Order on Language Processing: an Investigation Based on a Psycholinguistic Treebank of English

Dependency Distance As A Metric of Language Comprehension Difficulty

What Factors Are Associated with Dependency Distances to Ensure Easy Comprehension? A Case Study of Ba Sentences in Mandarin Chinese

Chinese Syntactic and Typological Properties Based on Dependency Syntactic Treebanks

Factors influencing dependency parsing of coordinating structure

The Role of Working Memory in Shaping Syntactic Dependency Structures

The Status of Function Words in Dependency Grammar: A Critique of Universal Dependencies (UD)

Dependency networks: A discussion note about Lamb’s theory of linguistic structure

Theoretical probability of dependency structural trees

The Effects of Genre on Dependency Distance and Dependency Direction

The Influence of Chunking on Dependency Crossing and Distance

The Complexity of Chinese Syntactic Dependency Networks

Using A Chinese Treebank to Measure Dependency Distance

Dependency Length Minimization: Puzzles and Promises.

The effects of sentence length on dependency distance, dependency direction and the implications–Based on a parallel English–Chinese dependency treebank

Revisiting English Written VP-ellipsis and VP-substitution: a Dependency-Based Analysis

A Chinese Dependency Syntax for Treebanking