Abstract:Rapid progress in machine learning for natural language processing has the potential to transform debates about how humans learn language. However, the learning environments and biases of current artificial learners and humans diverge in ways that weaken the impact of the evidence obtained from learning simulations. For example, today's most effective neural language models are trained on roughly one thousand times the amount of linguistic data available to a typical child. To increase the relevance of learnability results from computational models, we need to train model learners without significant advantages over humans. If an appropriate model successfully acquires some target linguistic knowledge, it can provide a proof of concept that the target is learnable in a hypothesized human learning scenario. Plausible model learners will enable us to carry out experimental manipulations to make causal inferences about variables in the learning environment, and to rigorously test poverty-of-the-stimulus-style claims arguing for innate linguistic knowledge in humans on the basis of speculations about learnability. Comparable experiments will never be possible with human subjects due to practical and ethical considerations, making model learners an indispensable resource. So far, attempts to deprive current models of unfair advantages obtain sub-human results for key grammatical behaviors such as acceptability judgments. But before we can justifiably conclude that language learning requires more prior domain-specific knowledge than current models possess, we must first explore non-linguistic inputs in the form of multimodal stimuli and multi-agent interaction as ways to make our learners more efficient at learning from limited linguistic input.

Language processing in humans and computers

Extending Machine Language Models toward Human-Level Language Understanding

Language in Brains, Minds, and Machines

Large language models as linguistic simulators and cognitive models in human research

Language Models: A Guide for the Perplexed

Placing language in an integrated understanding system: Next steps toward human-level performance in neural language models

Word meaning in minds and machines

Unravelling the Mysteries of Hallucination in Large Language Models: Strategies for Precision in Artificial Intelligence Language Generation

Beyond the limitations of any imaginable mechanism: large language models and psycholinguistics

LLMs Will Always Hallucinate, and We Need to Live With This

What Artificial Neural Networks Can Tell Us About Human Language Acquisition

Language models and psychological sciences

Can Language Models Be Tricked by Language Illusions? Easier with Syntax, Harder with Semantics

Dissociating language and thought in large language models: a cognitive perspective

Deception Abilities Emerged in Large Language Models

A Precis of Language Models are not Models of Language

Language Models Don't Learn the Physical Manifestation of Language

A Sentence is Worth a Thousand Pictures: Can Large Language Models Understand Hum4n L4ngu4ge and the W0rld behind W0rds?

Do Language Models Know When They're Hallucinating References?

Comprehending and Reducing LLM Hallucinations

Mechanistic Understanding and Mitigation of Language Model Non-Factual Hallucinations