Abstract:The review summarizes the main methodological concepts used in studying natural language from the perspective of complexity science and documents their applicability in identifying both universal and system-specific features of language in its written representation. Three main complexity-related research trends in quantitative linguistics are covered. The first part addresses the issue of word frequencies in texts and demonstrates that taking punctuation into consideration restores scaling whose violation in the Zipf's law is often observed for the most frequent words. The second part introduces methods inspired by time series analysis, used in studying various kinds of correlations in written texts. The related time series are generated on the basis of text partition into sentences or into phrases between consecutive punctuation marks. It turns out that these series develop features often found in signals generated by complex systems, like long-range correlations or (multi)fractal structures. Moreover, it appears that the distances between punctuation marks comply with the discrete variant of the Weibull distribution. In the third part, the application of the network formalism to natural language is reviewed, particularly in the context of the so-called word-adjacency networks. Parameters characterizing topology of such networks can be used for classification of texts, for example, from a stylometric perspective. Network approach can also be applied to represent the organization of word associations. Structure of word-association networks turns out to be significantly different from that observed in random networks, revealing genuine properties of language. Finally, punctuation seems to have a significant impact not only on the language's information-carrying ability but also on its key statistical properties, hence it is recommended to consider punctuation marks on a par with words.

Exploring the role of Punctuation in Parsing Natural Text

Incorporating External POS Tagger for Punctuation Restoration

A Linguistically Inspired Statistical Model for Chinese Punctuation Generation

Improving Dependency Parsing Using Punctuation

Punctuation and Text Division in Two Early Narratives

Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentation

Complex systems approach to natural language

Punctuation Prediction for Streaming On-Device Speech Recognition

Automatic punctuation generation for speech

Psycholinguistic Studies on Sentence Parsing in Language Comprehension

Unified Multimodal Punctuation Restoration Framework for Mixed-Modality Corpus

Revisiting English Written VP-ellipsis and VP-substitution: a Dependency-Based Analysis

Spontaneous Speech Parsing in Travel Information Inquiring and Booking Systems

Sentence Punctuation for Collaborative Commentary Generation in Esports Live-Streaming

CRF-based Approach to Sentence Segmentation and Punctuation for Ancient Chinese Prose

Corpus Annotation for Parser Evaluation

Principles of semantic and functional efficiency in grammatical patterning

Syntax in End-to-End Natural Language Processing

Integrating Supertag Features into Neural Discontinuous Constituent Parsing

Back Reaction of Strings in Self-Consistent String Cosmology

Predicting Punctuation in Ancient Chinese Texts: A Multi-Layered LSTM and Attention-Based Approach