Abstract:Today's large language models (LLMs) routinely generate coherent, grammatical and seemingly meaningful paragraphs of text. This achievement has led to speculation that these networks are -- or will soon become -- "thinking machines", capable of performing tasks that require abstract knowledge and reasoning. Here, we review the capabilities of LLMs by considering their performance on two different aspects of language use: 'formal linguistic competence', which includes knowledge of rules and patterns of a given language, and 'functional linguistic competence', a host of cognitive abilities required for language understanding and use in the real world. Drawing on evidence from cognitive neuroscience, we show that formal competence in humans relies on specialized language processing mechanisms, whereas functional competence recruits multiple extralinguistic capacities that comprise human thought, such as formal reasoning, world knowledge, situation modeling, and social cognition. In line with this distinction, LLMs show impressive (although imperfect) performance on tasks requiring formal linguistic competence, but fail on many tests requiring functional competence. Based on this evidence, we argue that (1) contemporary LLMs should be taken seriously as models of formal linguistic skills; (2) models that master real-life language use would need to incorporate or develop not only a core language module, but also multiple non-language-specific cognitive capacities required for modeling thought. Overall, a distinction between formal and functional linguistic competence helps clarify the discourse surrounding LLMs' potential and provides a path toward building models that understand and use language in human-like ways.

A Philosophical Introduction to Language Models - Part II: The Way Forward

A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates

Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understanding

Do Large Language Models Defend Inferentialist Semantics?: On the Logical Expressivism and Anti-Representationalism of LLMs

Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)

Large language models and linguistic intentionality

Language Models as Semiotic Machines: Reconceptualizing AI Language Systems through Structuralist and Post-Structuralist Theories of Language

The Limitations of Large Language Models for Understanding Human Language and Cognition

Beyond Words: A Mathematical Framework for Interpreting Large Language Models

Language models and psychological sciences

Large Language Models as Neurolinguistic Subjects: Identifying Internal Representations for Form and Meaning

Large language models as linguistic simulators and cognitive models in human research

Large Language Models: A Historical and Sociocultural Perspective

Language Models as Critical Thinking Tools: A Case Study of Philosophers

Decoding Large-Language Models: A Systematic Overview of Socio-Technical Impacts, Constraints, and Emerging Questions

Dissociating language and thought in large language models: a cognitive perspective

Large Language Models as Superpositions of Cultural Perspectives

Large Models of What? Mistaking Engineering Achievements for Human Linguistic Agency

Imitation and Large Language Models

Towards Uncovering How Large Language Model Works: An Explainability Perspective

No Such Thing as a General Learner: Language models and their dual optimization