Abstract:The wide adoption of Machine Learning technologies has created a rapidly growing demand for people who can train ML models. Some advocated the term "machine teacher" to refer to the role of people who inject domain knowledge into ML models. One promising learning paradigm is Active Learning (AL), by which the model intelligently selects instances to query the machine teacher for labels. However, in current AL settings, the human-AI interface remains minimal and opaque. We begin considering AI explanations as a core element of the human-AI interface for teaching machines. When a human student learns, it is a common pattern to present one's own reasoning and solicit feedback from the teacher. When a ML model learns and still makes mistakes, the human teacher should be able to understand the reasoning underlying the mistakes. When the model matures, the machine teacher should be able to recognize its progress in order to trust and feel confident about their teaching outcome. Toward this vision, we propose a novel paradigm of explainable active learning (XAL), by introducing techniques from the recently surging field of explainable AI (XAI) into an AL setting. We conducted an empirical study comparing the model learning outcomes, feedback content and experience with XAL, to that of traditional AL and coactive learning (providing the model's prediction without the explanation). Our study shows benefits of AI explanation as interfaces for machine teaching--supporting trust calibration and enabling rich forms of teaching feedback, and potential drawbacks--anchoring effect with the model judgment and cognitive workload. Our study also reveals important individual factors that mediate a machine teacher's reception to AI explanations, including task knowledge, AI experience and need for cognition. By reflecting on the results, we suggest future directions and design implications for XAL.

The Role of Higher-Order Cognitive Models in Active Learning

Active inference goes to school: the importance of active learning in the age of large language models

Learning Cognitive Models using Neural Networks

Iterative Teacher-Aware Learning

Active Learning is About More Than Hands-On: A Mixed-Reality AI System to Support STEM Education

Resonating Minds -- Emergent Collaboration Through Hierarchical Active Inference

Cognitive Architecture for Mutual Modelling

AI as Extraherics: Fostering Higher-order Thinking Skills in Human-AI Interaction

ICE: Enabling Non-Experts to Build Models Interactively for Large-Scale Lopsided Problems

Active Reward Learning from Multiple Teachers

Interactive Learning from Policy-Dependent Human Feedback

Unveiling the latent dynamics in social cognition with multi-agent inverse reinforcement learning

Human and AI collaboration in the higher education environment: opportunities and concerns

Toward Autonomy: Metacognitive Learning for Enhanced AI Performance

Human-Like Active Learning: Machines Simulating the Human Learning Process

Collaborative Active Learning in Conditional Trust Environment

Shifting the Human-AI Relationship: Toward a Dynamic Relational Learning-Partner Model

Explainable Active Learning (XAL): An Empirical Study of How Local Explanations Impact Annotator Experience

Team Learning as a Lens for Designing Human-AI Co-Creative Systems

Active Hierarchical Imitation and Reinforcement Learning

Towards Modeling and Influencing the Dynamics of Human Learning