Abstract:Humans have internal models of robots (like their physical capabilities), the world (like what will happen next), and their tasks (like a preferred goal). However, human internal models are not always perfect: for example, it is easy to underestimate a robot's inertia. Nevertheless, these models change and improve over time as humans gather more experience. Interestingly, robot actions influence what this experience is, and therefore influence how people's internal models change. In this work we take a step towards enabling robots to understand the influence they have, leverage it to better assist people, and help human models more quickly align with reality. Our key idea is to model the human's learning as a nonlinear dynamical system which evolves the human's internal model given new observations. We formulate a novel optimization problem to infer the human's learning dynamics from demonstrations that naturally exhibit human learning. We then formalize how robots can influence human learning by embedding the human's learning dynamics model into the robot planning problem. Although our formulations provide concrete problem statements, they are intractable to solve in full generality. We contribute an approximation that sacrifices the complexity of the human internal models we can represent, but enables robots to learn the nonlinear dynamics of these internal models. We evaluate our inference and planning methods in a suite of simulated environments and an in-person user study, where a 7DOF robotic arm teaches participants to be better teleoperators. While influencing human learning remains an open problem, our results demonstrate that this influence is possible and can be helpful in real human-robot interaction.

Modeling Adaptive Expression of Robot Learning Engagement and Exploring its Effects on Human Teachers

Investigating the Effects of Robot Engagement Communication on Learning from Demonstration

Multi-robot behavior adaptation to local and global communication atmosphere in humans-robots interaction

How Can Everyday Users Efficiently Teach Robots by Demonstrations?

Human-Robot Emotional Interaction Model Based on Reinforcement Learning

Adapting Multi-Robot Behavior to Communication Atmosphere in Humans-Robots Interaction Using Fuzzy Production Rule Based Friend-Q Learning

Nonverbal Robot Feedback for Human Teachers

Towards Transparency of TD-RL Robotic Systems with a Human Teacher

Towards Modeling and Influencing the Dynamics of Human Learning

Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human-Robot Interaction

Quantifying Teaching Behaviour in Robot Learning from Demonstration

Interactive RL Via Online Human Demonstrations.

Learning to Communicate Functional States with Nonverbal Expressions for Improved Human-Robot Collaboration

Learning from Demonstrations Via Multi-Level and Multi-Attention Domain-Adaptive Meta-Learning

Demonstration Guided Actor-Critic Deep Reinforcement Learning for Fast Teaching of Robots in Dynamic Environments

On the Effect of Robot Errors on Human Teaching Dynamics

Modeling Engagement in Long-Term, In-Home Socially Assistive Robot Interventions for Children with Autism Spectrum Disorders

Improving Robot-Centric Learning from Demonstration via Personalized Embeddings

How Much Progress Did I Make? An Unexplored Human Feedback Signal for Teaching Robots

Human-Robot Interaction and Demonstration Learning Mode Based on Electromyogram Signal and Variable Impedance Control

Discovering Robotic Interaction Modes with Discrete Representation Learning