Abstract:This letter explores the intricate historical and contemporary links between large language models (LLMs) and cognitive science through the lens of information theory, statistical language models, and socioanthropological linguistic theories. The emergence of LLMs highlights the enduring significance of information‐based and statistical learning theories in understanding human communication. These theories, initially proposed in the mid‐20th century, offered a visionary framework for integrating computational science, social sciences, and humanities, which nonetheless was not fully fulfilled at that time. The subsequent development of sociolinguistics and linguistic anthropology, especially since the 1970s, provided critical perspectives and empirical methods that both challenged and enriched this framework. This letter proposes that two pivotal concepts derived from this development, metapragmatic function and indexicality, offer a fruitful theoretical perspective for integrating the semantic, textual, and pragmatic, contextual dimensions of communication, an amalgamation that contemporary LLMs have yet to fully achieve. The author believes that contemporary cognitive science is at a crucial crossroads, where fostering interdisciplinary dialogues among computational linguistics, social linguistics and linguistic anthropology, and cognitive and social psychology is in particular imperative. Such collaboration is vital to bridge the computational, cognitive, and sociocultural aspects of human communication and human−AI interaction, especially in the era of large language and multimodal models and human‐centric Artificial Intelligence (AI).

Studying large language models as compression algorithms for human culture

Large Language Models Demonstrate the Potential of Statistical Learning in Language

Investigating Cultural Alignment of Large Language Models

Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges

Large Language Models: A Historical and Sociocultural Perspective

Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)

Large Language Models Humanize Technology

Language Modeling Is Compression

On Classification with Large Language Models in Cultural Analytics

CultureLLM: Incorporating Cultural Differences into Large Language Models

Exploring Large Language Models on Cross-Cultural Values in Connection with Training Methodology

Divergent Creativity in Humans and Large Language Models

Decoding Large-Language Models: A Systematic Overview of Socio-Technical Impacts, Constraints, and Emerging Questions

Large Language Models: A Survey

From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models

An Interdisciplinary Outlook on Large Language Models for Scientific Research

Can Large Language Models Transform Computational Social Science?

An analysis of large language models: their impact and potential applications

Towards Measuring and Modeling "Culture" in LLMs: A Survey

Exploring the landscape of large language models: Foundations, techniques, and challenges

Multilingual Large Language Models and Curse of Multilinguality