Abstract:In recent years, graph theory has been widely employed to probe several language properties. More specifically, the so-called word adjacency model has been proven useful for tackling several practical problems, especially those relying on textual stylistic analysis. The most common approach to treat texts as networks has simply considered either large pieces of texts or entire books. This approach has certainly worked well -- many informative discoveries have been made this way -- but it raises an uncomfortable question: could there be important topological patterns in small pieces of texts? To address this problem, the topological properties of subtexts sampled from entire books was probed. Statistical analyzes performed on a dataset comprising 50 novels revealed that most of the traditional topological measurements are stable for short subtexts. When the performance of the authorship recognition task was analyzed, it was found that a proper sampling yields a discriminability similar to the one found with full texts. Surprisingly, the support vector machine classification based on the characterization of short texts outperformed the one performed with entire books. These findings suggest that a local topological analysis of large documents might improve its global characterization. Most importantly, it was verified, as a proof of principle, that short texts can be analyzed with the methods and concepts of complex networks. As a consequence, the techniques described here can be extended in a straightforward fashion to analyze texts as time-varying complex networks.

Language Clustering with Word Co-Occurrence Networks Based on Parallel Texts

Language clusters based on linguistic complex networks

Can syntactic networks indicate morphological complexity of a language?

Differentiating Interpreting Types: Connecting Complex Networks to Cognitive Complexity

Approaching Human Language with Complex Networks.

Lexical Diversity As a Lens into the Classification of Slavic Languages: A Quantitative Typology Perspective.

Comparison study of using semantic and syntactic network characteristics to do text clustering

Linguistic emergence from a networks approach: The case of modern Chinese two-character words.

Linguistic Networks:Metaphor or Tool?

English and Chinese Languages As Weighted Complex Networks

How Does Language Change As a Lexical Network? an Investigation Based on Written Chinese Word Co-Occurrence Networks

An Empirical Study of Chinese Language Networks

Initial Comparison of Linguistic Networks Measures for Parallel Texts

Chinese Writing of Deaf or Hard-of-hearing Students and Normal-hearing Peers from Complex Network Approach

Language comparison via network topology

EMPIRICAL CHARACTERIZATION OF MODERN CHINESE AS A MULTI-LEVEL SYSTEM FROM THE COMPLEX NETWORK APPROACH

How Do Local Syntactic Structures Influence Global Properties in Language Networks?

Chinese Word Co-occurrence Network: Its Small World Effect and Scale-free Property

Statistical Properties of Chinese Semantic Networks

Probing the topological properties of complex networks modeling short written texts

Semantic Correlation Network Based Text Clustering