Abstract:The topic of comprehensibility of machine-learned theories has recently drawn increasing attention. Inductive logic programming uses logic programming to derive logic theories from small data based on abduction and induction techniques. Learned theories are represented in the form of rules as declarative descriptions of obtained knowledge. In earlier work, the authors provided the first evidence of a measurable increase in human comprehension based on machine-learned logic rules for simple classification tasks. In a later study, it was found that the presentation of machine-learned explanations to humans can produce both beneficial and harmful effects in the context of game learning. We continue our investigation of comprehensibility by examining the effects of the ordering of concept presentations on human comprehension. In this work, we examine the explanatory effects of curriculum order and the presence of machine-learned explanations for sequential problem-solving. We show that (1) there exist tasks A and B such that learning A before learning B results in better comprehension for humans in comparison to learning B before learning A and (2) there exist tasks A and B such that the presence of explanations when learning A contributes to improved human comprehension when subsequently learning B. We propose a framework for the effects of sequential teaching on comprehension based on an existing definition of comprehensibility and provide evidence for support from data collected in human trials. Our empirical study involves curricula that teach novices the merge sort algorithm. Our results show that sequential teaching of concepts with increasing complexity (a) has a beneficial effect on human comprehension and (b) leads to human re-discovery of divide-and-conquer problem-solving strategies, and (c) allows adaptations of human problem-solving strategy with better performance when machine-learned explanations are also presented.

An Optimal Control Approach to Sequential Machine Teaching

Teaching to Learn: Sequential Teaching of Agents with Inner States

Machine Teaching of Active Sequential Learners

Machine Teaching: An Inverse Problem to Machine Learning and an Approach Toward Optimal Education

Preference-Based Batch and Sequential Teaching

Preference-Based Batch and Sequential Teaching: Towards a Unified View of Models

Manipulating Predictions over Discrete Inputs in Machine Teaching

Machine Teaching for Bayesian Learners in the Exponential Family

Adaptive Teaching of Temporal Logic Formulas to Learners with Preferences

Iterative Teacher-Aware Learning

Explanatory machine learning for sequential human teaching

Probabilistic design of optimal sequential decision-making algorithms in learning and control

Optimal Learning Control Scheme for Discrete-Time Systems with Nonuniform Trials.

Using Machine Teaching to Investigate Human Assumptions when Teaching Reinforcement Learners

One-shot Machine Teaching: Cost Very Few Examples to Converge Faster

Barrier Certificates for Assured Machine Teaching

Understanding the Role of Adaptivity in Machine Teaching: The Case of Version Space Learners

Collaborative and Privacy-Preserving Machine Teaching via Consensus Optimization

Optimal targeting of nonlinear chaotic systems using a novel evolutionary computing strategy

Distribution Matching for Machine Teaching

Nonparametric Iterative Machine Teaching