Abstract:In this paper we argue that key, often sensational and misleading, claims regarding linguistic capabilities of Large Language Models (LLMs) are based on at least two unfounded assumptions; the assumption of language completeness and the assumption of data completeness. Language completeness assumes that a distinct and complete thing such as `a natural language' exists, the essential characteristics of which can be effectively and comprehensively modelled by an LLM. The assumption of data completeness relies on the belief that a language can be quantified and wholly captured by data. Work within the enactive approach to cognitive science makes clear that, rather than a distinct and complete thing, language is a means or way of acting. Languaging is not the kind of thing that can admit of a complete or comprehensive modelling. From an enactive perspective we identify three key characteristics of enacted language; embodiment, participation, and precariousness, that are absent in LLMs, and likely incompatible in principle with current architectures. We argue that these absences imply that LLMs are not now and cannot in their present form be linguistic agents the way humans are. We illustrate the point in particular through the phenomenon of `algospeak', a recently described pattern of high stakes human language activity in heavily controlled online environments. On the basis of these points, we conclude that sensational and misleading claims about LLM agency and capabilities emerge from a deep misconception of both what human language is and what LLMs are.

Reinterpreting 'the Company a Word Keeps': Towards Explainable and Ontologically Grounded Language Models

Stochastic LLMs do not Understand Language: Towards Symbolic, Explainable and Ontologically Based LLMs

Towards Explainable and Language-Agnostic LLMs: Symbolic Reverse Engineering of Language at Scale

Symbolic and Language Agnostic Large Language Models

Towards Uncovering How Large Language Model Works: An Explainability Perspective

LLMs' Understanding of Natural Language Revealed

Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement

Argumentative Large Language Models for Explainable and Contestable Decision-Making

Symbols and grounding in large language models

Large Language Models Cannot Explain Themselves

Rethinking Interpretability in the Era of Large Language Models

Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understanding

Large Language Models Are In-Context Semantic Reasoners Rather Than Symbolic Reasoners

Large Language Models are Interpretable Learners

A Philosophical Introduction to Language Models - Part II: The Way Forward

Opening the Black Box of Large Language Models: Two Views on Holistic Interpretability

Towards Logically Consistent Language Models via Probabilistic Reasoning

Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)

Large Models of What? Mistaking Engineering Achievements for Human Linguistic Agency

Do large language models "understand" their knowledge?

The Quo Vadis of the Relationship between Language and Large Language Models