Abstract:Knowledge built culturally across generations allows humans to learn far more than an individual could glean from their own experience in a lifetime. Cultural knowledge in turn rests on language: language is the richest record of what previous generations believed, valued, and practiced, and how these evolved over time. The power and mechanisms of language as a means of cultural learning, however, are not well understood, and as a result, current AI systems do not leverage language as a means for cultural knowledge transmission. Here, we take a first step towards reverse-engineering cultural learning through language. We developed a suite of complex tasks in the form of minimalist-style video games, which we deployed in an iterated learning paradigm. Human participants were limited to only two attempts (two lives) to beat each game and were allowed to write a message to a future participant who read the message before playing. Knowledge accumulated gradually across generations, allowing later generations to advance further in the games and perform more efficient actions. Multigenerational learning followed a strikingly similar trajectory to individuals learning alone with an unlimited number of lives. Successive generations of learners were able to succeed by expressing distinct types of knowledge in natural language: the dynamics of the environment, valuable goals, dangerous risks, and strategies for success. The video game paradigm we pioneer here is thus a rich test bed for developing AI systems capable of acquiring and transmitting cultural knowledge.

Learn How to Cook a New Recipe in a New House: Using Map Familiarization, Curriculum Learning, and Bandit Feedback to Learn Families of Text-Based Adventure Games

Ambient Adventures: Teaching ChatGPT on Developing Complex Stories

Transfer in Deep Reinforcement Learning using Knowledge Graphs

Using reinforcement learning to learn how to play text-based games

Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learning

Abstract then Play: A Skill-centric Reinforcement Learning Framework for Text-based Games.

Zero-Shot Learning of Text Adventure Games with Sentence-Level Semantics

Situated Language Learning via Interactive Narratives

Learning to Play Text-based Adventure Games with Maximum Entropy Reinforcement Learning

Learning to Speak and Act in a Fantasy Text Adventure Game

Mastering the Dungeon: Grounded Language Learning by Mechanical Turker Descent

ScriptWorld: Text Based Environment For Learning Procedural Knowledge

Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals

Learning to Win by Reading Manuals in a Monte-Carlo Framework

EXPLORER: Exploration-guided Reasoning for Textual Reinforcement Learning

Taking the Scenic Route: Automatic Exploration for Videogames

Learning to solve complex tasks by growing knowledge culturally across generations

Situated Dialogue Learning through Procedural Environment Generation

Hands-Free: Action Abstraction with Hierarchical Reinforcement Learning in Text-Based Games

Deep Apprenticeship Learning for Playing Games

Interactive Fiction Games: A Colossal Adventure