Abstract:Adaptive machines have the potential to assist or interfere with human behavior in a range of contexts, from cognitive decision-making to physical device assistance. Therefore it is critical to understand how machine learning algorithms can influence human actions, particularly in situations where machine goals are misaligned with those of people. Since humans continually adapt to their environment using a combination of explicit and implicit strategies, when the environment contains an adaptive machine, the human and machine play a game. Game theory is an established framework for modeling interactions between two or more decision-makers that has been applied extensively in economic markets and machine algorithms. However, existing approaches make assumptions about, rather than empirically test, how adaptation by individual humans is affected by interaction with an adaptive machine. Here we tested learning algorithms for machines playing general-sum games with human subjects. Our algorithms enable the machine to select the outcome of the co-adaptive interaction from a constellation of game-theoretic equilibria in action and policy spaces. Importantly, the machine learning algorithms work directly from observations of human actions without solving an inverse problem to estimate the human's utility function as in prior work. Surprisingly, one algorithm can steer the human-machine interaction to the machine's optimum, effectively controlling the human's actions even while the human responds optimally to their perceived cost landscape. Our results show that game theory can be used to predict and design outcomes of co-adaptive interactions between intelligent humans and machines.

Safe Human-Machine Cooperative Game with Level-k Rationality Modeled Human Impact

A Game-Theoretic Method for Resilient Control Design in Industrial Multi-Agent CPSs with Markovian and Coupled Dynamics

Risk-Sensitive Cooperative Games for Human-Machine Systems

Safety Assurances for Human-Robot Interaction via Confidence-aware Game-theoretic Human Models

Look Before You Leap: Safe Model-Based Reinforcement Learning with Human Intervention

When Humans Aren't Optimal: Robots that Collaborate with Risk-Aware Humans

Game-Based Approximate Optimal Motion Planning for Safe Human-Swarm Interaction

Adaptive authority dynamic game for human-machine cooperative control

Research on Cobot Action Decision-Making Method Based on Intuitionistic Fuzzy Set and Game Theory

Game-Theoretic Modeling of Human Adaptation in Human-Robot Collaboration

A Cooperative Robust Human Resource Allocation Problem for Healthcare Systems for Disaster Management

Generalized dynamic cognitive hierarchy models for strategic driving behavior

Rethinking Safe Control in the Presence of Self-Seeking Humans

Human adaptation to adaptive machines converges to game-theoretic equilibria

On Repeated Stackelberg Security Game with the Cooperative Human Behavior Modelfor Wildlife Protection.

Robots that Learn to Safely Influence via Prediction-Informed Reach-Avoid Dynamic Games

Towards Safe Multi-Level Human-Robot Interaction in Industrial Tasks

Cooperative Markov Decision Process model for human–machine co-adaptation in robot-assisted rehabilitation

Human Machine Co-adaption Interface via Cooperation Markov Decision Process System

Dynamic Game-Theoretical Decision-Making Framework for Vehicle-Pedestrian Interaction with Human Bounded Rationality

A Model of Risk and Mental State Shifts during Social Interaction