Building Machines that Learn and Think with People

Katherine M. Collins,Ilia Sucholutsky,Umang Bhatt,Kartik Chandra,Lionel Wong,Mina Lee,Cedegao E. Zhang,Tan Zhi-Xuan,Mark Ho,Vikash Mansinghka,Adrian Weller,Joshua B. Tenenbaum,Thomas L. Griffiths

2024-07-22

Abstract:What do we want from machine intelligence? We envision machines that are not just tools for thought, but partners in thought: reasonable, insightful, knowledgeable, reliable, and trustworthy systems that think with us. Current artificial intelligence (AI) systems satisfy some of these criteria, some of the time. In this Perspective, we show how the science of collaborative cognition can be put to work to engineer systems that really can be called ``thought partners,'' systems built to meet our expectations and complement our limitations. We lay out several modes of collaborative thought in which humans and AI thought partners can engage and propose desiderata for human-compatible thought partnerships. Drawing on motifs from computational cognitive science, we motivate an alternative scaling path for the design of thought partners and ecosystems around their use through a Bayesian lens, whereby the partners we construct actively build and reason over models of the human and world.

Human-Computer Interaction,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

This paper explores how to build machine intelligence systems that can think collaboratively with humans, known as "thought partners." The authors propose a new perspective aimed at designing systems that can truly serve as effective thought partners for humans. These systems should not only understand human users but also be understood by them and possess sufficient world knowledge to interact on a common basis.

To achieve this goal, the paper first defines three criteria that an ideal thought partner should meet:
1. **You understand me**: The thought partner should be able to understand the human user's goals, plans, beliefs, and resource constraints.
2. **I understand you**: The thought partner's behavior should be predictable and easy to understand, with communication methods that align with the human user's intuition.
3. **We understand the world**: The thought partner should operate based on knowledge of the real world and share an understanding and representation of the world with the human user.

The paper further suggests that to engineer these standards, one can draw on theoretical frameworks from computational cognitive science, particularly Bayesian methods. Specifically, it advocates for constructing explicit models to represent tasks, the world, and human users, rather than relying solely on distributions learned from big data. Additionally, the paper emphasizes the need for technologies like probabilistic programming to support this complex modeling and reasoning process.

The paper illustrates how to apply these theoretical frameworks and technologies to build different types of thought partners through several case studies, including but not limited to:
- **Programming assistants**: Programming aid tools that can understand the programmer's intent and help solve problems.
- **Physical assistance assistants**: Robotic assistants that collaborate with humans to perform tasks in physical environments.
- **Story creation assistants**: Story creation tools that assist writers and other creators in brainstorming storylines and ideas.
- **Medical assistants**: Medical support systems that assist doctors in decision-making and support patient care in medical settings.

In summary, the core of this paper is to propose a new design philosophy aimed at building machine intelligence systems that can better collaborate with humans, with the goal of enhancing human-machine collaboration in the future.