Abstract:This thesis is about the problem of compositionality in distributional semantics. Distributional semantics presupposes that the meanings of words are a function of their occurrences in textual contexts. It models words as distributions over these contexts and represents them as vectors in high dimensional spaces. The problem of compositionality for such models concerns itself with how to produce representations for larger units of text by composing the representations of smaller units of text. This thesis focuses on a particular approach to this compositionality problem, namely using the categorical framework developed by Coecke, Sadrzadeh, and Clark, which combines syntactic analysis formalisms with distributional semantic representations of meaning to produce syntactically motivated composition operations. This thesis shows how this approach can be theoretically extended and practically implemented to produce concrete compositional distributional models of natural language semantics. It furthermore demonstrates that such models can perform on par with, or better than, other competing approaches in the field of natural language processing. There are three principal contributions to computational linguistics in this thesis. The first is to extend the DisCoCat framework on the syntactic front and semantic front, incorporating a number of syntactic analysis formalisms and providing learning procedures allowing for the generation of concrete compositional distributional models. The second contribution is to evaluate the models developed from the procedures presented here, showing that they outperform other compositional distributional models present in the literature. The third contribution is to show how using category theory to solve linguistic problems forms a sound basis for research, illustrated by examples of work on this topic, that also suggest directions for future research.

DisCoCat for Donkey Sentences

Higher-Order DisCoCat (Peirce-Lambek-Montague semantics)

Donkey Pronouns in Child Mandarin: Insights into the ∃/∀ Dichotomy

A Categorical Compositional Distributional Modelling for the Language of Life

Catenae: Introducing a Novel Unit of Syntactic Analysis

Recursive Deep Models for Discourse Parsing

Constructions Are Catenae: Construction Grammar Meets Dependency Grammar

Towards Compositional Distributional Discourse Analysis

Experimental Support for a Categorical Compositional Distributional Model of Meaning

Antecedent Containment: A Dependency Grammar Solution In Terms Of Catenae

Katena Und Konstruktion: Ein Vorschlag Zu Einer Dependenziellen Konstruktionsgrammatik

The Do-So-Diagnostic: Against Finite Vps and for Flat Non-Finite Vps

Bracketing paradoxes: a dependency grammar analysis in terms of morph catenae

A Pipeline For Discourse Circuits From CCG

An algebraic approach to translating Japanese

Ellipsis in Dependency Grammar

Entity-Augmented Distributional Semantics for Discourse Relations

Harmonic Grammar in a DisCo Model of Meaning

Language-independence of DisCoCirc's Text Circuits: English and Urdu

Category-Theoretic Quantitative Compositional Distributional Models of Natural Language Semantics

Sentence Entailment in Compositional Distributional Semantics