Abstract:How does language inform our downstream thinking? In particular, how do humans make meaning from language--and how can we leverage a theory of linguistic meaning to build machines that think in more human-like ways? In this paper, we propose rational meaning construction, a computational framework for language-informed thinking that combines neural language models with probabilistic models for rational inference. We frame linguistic meaning as a context-sensitive mapping from natural language into a probabilistic language of thought (PLoT)--a general-purpose symbolic substrate for generative world modeling. Our architecture integrates two computational tools that have not previously come together: we model thinking with probabilistic programs, an expressive representation for commonsense reasoning; and we model meaning construction with large language models (LLMs), which support broad-coverage translation from natural language utterances to code expressions in a probabilistic programming language. We illustrate our framework through examples covering four core domains from cognitive science: probabilistic reasoning, logical and relational reasoning, visual and physical reasoning, and social reasoning. In each, we show that LLMs can generate context-sensitive translations that capture pragmatically-appropriate linguistic meanings, while Bayesian inference with the generated programs supports coherent and robust commonsense reasoning. We extend our framework to integrate cognitively-motivated symbolic modules (physics simulators, graphics engines, and planning algorithms) to provide a unified commonsense thinking interface from language. Finally, we explore how language can drive the construction of world models themselves. We hope this work will provide a roadmap towards cognitive models and AI systems that synthesize the insights of both modern and classical computational perspectives.

Co-creating a globally interpretable model with human input

Enhancing Human-AI Collaboration Through Logic-Guided Reasoning

Algorithms for the Greater Good! On Mental Modeling and Acceptable Symbiosis in Human-AI Collaboration

A Model for Intelligible Interaction Between Agents That Predict and Explain

Envisioning a Human-AI collaborative system to transform policies into decision models

Effective Representation to Capture Collaboration Behaviors between Explainer and User

Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)

Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptation

Effective Human-AI Teams via Learned Natural Language Rules and Onboarding

Accelerating human-computer interaction through convergent conditions for LLM explanation

Shifting the Human-AI Relationship: Toward a Dynamic Relational Learning-Partner Model

Mapping the Design Space of Interactions in Human-AI Text Co-creation Tasks

From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought

Towards Dialogues for Joint Human-AI Reasoning and Value Alignment

Learning To Guide Human Decision Makers With Vision-Language Models

Visual-O1: Understanding Ambiguous Instructions via Multi-modal Multi-turn Chain-of-thoughts Reasoning

Deconstructing Human‐AI Collaboration: Agency, Interaction, and Adaptation

Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks

Human-Modeling in Sequential Decision-Making: An Analysis through the Lens of Human-Aware AI

Meaningful Models: Utilizing Conceptual Structure to Improve Machine Learning Interpretability

Interacting Large Language Model Agents. Interpretable Models and Social Learning