Abstract:Approaches to Natural language processing (NLP) may be classified along a double dichotomy open/opaque - strict/adaptive. The former axis relates to the possibility of inspecting the underlying processing rules, the latter to the use of fixed or adaptive rules. We argue that many techniques fall into either the open-strict or opaque-adaptive categories. Our contribution takes steps in the open-adaptive direction, which we suggest is likely to provide key instruments for interdisciplinary research. The central idea of our approach is the Semantic Hypergraph (SH), a novel knowledge representation model that is intrinsically recursive and accommodates the natural hierarchical richness of natural language. The SH model is hybrid in two senses. First, it attempts to combine the strengths of ML and symbolic approaches. Second, it is a formal language representation that reduces but tolerates ambiguity and structural variability. We will see that SH enables simple yet powerful methods of pattern detection, and features a good compromise for intelligibility both for humans and machines. It also provides a semantically deep starting point (in terms of explicit meaning) for further algorithms to operate and collaborate on. We show how modern NLP ML-based building blocks can be used in combination with a random forest classifier and a simple search tree to parse NL to SH, and that this parser can achieve high precision in a diversity of text categories. We define a pattern language representable in SH itself, and a process to discover knowledge inference rules. We then illustrate the efficiency of the SH framework in a variety of tasks, including conjunction decomposition, open information extraction, concept taxonomy inference and co-reference resolution, and an applied example of claim and conflict analysis in a news corpus.

Hrebs and Cohesion Chains as similar tools for semantic text properties research

Density Fluctuations in Traffic Flow

The Tool for the Automatic Analysis of Cohesion 2.0: Integrating semantic similarity and text overlap

Quantitative Discourse Cohesion Analysis of Scientific Scholarly Texts using Multilayer Networks

Document Relevance Calculation Based on Lexical Cohesion

Structural Cohesion: Visualization and Heuristics for Fast Computation

Holographic Lexical Chain And Its Application In Chinese Text Summarization

Comparison study of using semantic and syntactic network characteristics to do text clustering

Lexical Chain Based Cohesion Models for Document-Level Statistical Machine Translation.

Assessment of text coherence based on the cohesion estimation

Mathematical Foundations of Data Cohesion

Automatic Text Summarization Based on Textual Cohesion

The Lexical Context in a Style Analysis: A Word Embeddings Approach

Semantic Hypergraphs

Looking at words and points with attention: a benchmark for text-to-shape coherence

`Keep it Together': Enforcing Cohesion in Extractive Summaries by Simulating Human Memory

A Computational Approach to Measuring the Semantic Divergence of Cognates

A Novel Computational and Modeling Foundation for Automatic Coherence Assessment

The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion

Anaphora Resolution As Lexical Cohesion Identification

A Similarity Measure for Weaving Patterns in Textiles