Abstract:Generative AI, particularly Language Models (LMs), has the potential to transform real-world domains with societal impact, particularly where access to experts is limited. For example, in education, training novice educators with expert guidance is important for effectiveness but expensive, creating significant barriers to improving education quality at scale. This challenge disproportionately harms students from under-served communities, who stand to gain the most from high-quality education. We introduce Tutor CoPilot, a novel Human-AI approach that leverages a model of expert thinking to provide expert-like guidance to tutors as they tutor. This study is the first randomized controlled trial of a Human-AI system in live tutoring, involving 900 tutors and 1,800 K-12 students from historically under-served communities. Following a preregistered analysis plan, we find that students working with tutors that have access to Tutor CoPilot are 4 percentage points (p.p.) more likely to master topics (p<0.01). Notably, students of lower-rated tutors experienced the greatest benefit, improving mastery by 9 p.p. We find that Tutor CoPilot costs only $20 per-tutor annually. We analyze 550,000+ messages using classifiers to identify pedagogical strategies, and find that tutors with access to Tutor CoPilot are more likely to use high-quality strategies to foster student understanding (e.g., asking guiding questions) and less likely to give away the answer to the student. Tutor interviews highlight how Tutor CoPilot's guidance helps tutors to respond to student needs, though they flag issues in Tutor CoPilot, such as generating suggestions that are not grade-level appropriate. Altogether, our study of Tutor CoPilot demonstrates how Human-AI systems can scale expertise in real-world domains, bridge gaps in skills and create a future where high-quality education is accessible to all students.

Augmenting Flight Training with AI to Efficiently Train Pilots

Using an Artificial Intelligence (AI) Agent to Support Teacher Instruction and Student Learning

AI Agents and Education: Simulated Practice at Scale

Learning to Assist and Communicate with Novice Drone Pilots for Expert Level Performance

A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers

AI Enabled Maneuver Identification via the Maneuver Identification Challenge

Artificial Intelligence Simulation Research Based on Aviation Flight Training Technology

Artificial Intelligence for Real-Time Tolerance to Critical Flight Data Errors in Large Aircraft

Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise

Artificial Intelligence in Adaptive In-Cab Interfaces

Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulator

Design and evaluation of AI copilots -- case studies of retail copilot templates

Artificial Intelligence as a Dynamic Copilot in Entrepreneurship Education

Assistive Teaching of Motor Control Tasks to Humans

AI2T: Building Trustable AI Tutors by Interactively Teaching a Self-Aware Learning Agent

Artificial Intelligence Ecosystem for Automating Self-Directed Teaching

Teaching Drones on the Fly: Can Emotional Feedback Serve as Learning Signal for Training Artificial Agents?

Instructors as Innovators: A future-focused approach to new AI learning opportunities, with prompts

Artificial Intelligence: A Universal Virtual Tool to Augment Tutoring in Higher Education

Combating Spatial Disorientation in a Dynamic Self-Stabilization Task Using AI Assistants

Assigning AI: Seven Approaches for Students, with Prompts