What Meaning-Form Correlation Has to Compose With

Timothee Mickus,Timothée Bernard,Denis Paperno
DOI: https://doi.org/10.48550/arXiv.2012.03833
2020-12-07
Computation and Language
Abstract:Compositionality is a widely discussed property of natural languages, although its exact definition has been elusive. We focus on the proposal that compositionality can be assessed by measuring meaning-form correlation. We analyze meaning-form correlation on three sets of languages: (i) artificial toy languages tailored to be compositional, (ii) a set of English dictionary definitions, and (iii) a set of English sentences drawn from literature. We find that linguistic phenomena such as synonymy and ungrounded stop-words weigh on MFC measurements, and that straightforward methods to mitigate their effects have widely varying results depending on the dataset they are applied to. Data and code are made publicly available.
What problem does this paper attempt to address?