Abstract:How does language inform our downstream thinking? In particular, how do humans make meaning from language--and how can we leverage a theory of linguistic meaning to build machines that think in more human-like ways? In this paper, we propose rational meaning construction, a computational framework for language-informed thinking that combines neural language models with probabilistic models for rational inference. We frame linguistic meaning as a context-sensitive mapping from natural language into a probabilistic language of thought (PLoT)--a general-purpose symbolic substrate for generative world modeling. Our architecture integrates two computational tools that have not previously come together: we model thinking with probabilistic programs, an expressive representation for commonsense reasoning; and we model meaning construction with large language models (LLMs), which support broad-coverage translation from natural language utterances to code expressions in a probabilistic programming language. We illustrate our framework through examples covering four core domains from cognitive science: probabilistic reasoning, logical and relational reasoning, visual and physical reasoning, and social reasoning. In each, we show that LLMs can generate context-sensitive translations that capture pragmatically-appropriate linguistic meanings, while Bayesian inference with the generated programs supports coherent and robust commonsense reasoning. We extend our framework to integrate cognitively-motivated symbolic modules (physics simulators, graphics engines, and planning algorithms) to provide a unified commonsense thinking interface from language. Finally, we explore how language can drive the construction of world models themselves. We hope this work will provide a roadmap towards cognitive models and AI systems that synthesize the insights of both modern and classical computational perspectives.

A Computational Model for Machine Thinking

Machine Cognition Models: EPAM and GPS

AI Consciousness is Inevitable: A Theoretical Computer Science Perspective

Cognitive Models for Machine Theory of Mind

Ethics of autonomous information systems towards an artificial thinking

Building Machines that Learn and Think with People

A Model of Spatial Thinking for Computational Intelligence

Computational principles of intelligence: learning and reasoning with neural networks

Building Machines That Learn and Think Like People

Towards a theory of consciousness: Proposal for the resolution of the homunculus fallacy with predictions

A Machine Consciousness architecture based on Deep Learning and Gaussian Processes

Can I say, now machines can think?

From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought

An affective computational model for machine consciousness

Building Thinking Machines by Solving Animal Cognition Tasks

A Cognitive Architecture for Machine Consciousness and Artificial Superintelligence: Thought Is Structured by the Iterative Updating of Working Memory

Thinging for Computational Thinking

Using Machine Learning to Guide Cognitive Modeling: A Case Study in Moral Reasoning

Extending Machine Language Models toward Human-Level Language Understanding

Dissociating language and thought in large language models: a cognitive perspective

A Brain-Inspired Model of Theory of Mind