Abstract:To enhance the collaborative intelligence of a machine, it is important for the machine to understand what behavior a human may adopt to interact with the machine when performing a task in shared control. In this study, an online behavior learning method is proposed for continuous-time linear human-in-the-loop shared control systems by using the system state data only. A two-player nonzero-sum linear quadratic dynamic game paradigm is used for modeling the control interaction between a human operator and an automation that actively compensates for human control action. In this game model, the cost function representing the human behavior is assumed to have an unknown weighting matrix. Here, we want to learn the human behavior or retrieve the weighting matrix by using the system state data only. Accordingly, a new adaptive inverse differential game (IDG) method, which integrates concurrent learning (CL) and linear matrix inequality (LMI) optimization, is proposed. First, a CL-based adaptive law and an interactive controller of the automation are developed to estimate the feedback gain matrix of the human online, and second, an LMI optimization problem is solved to determine the weighting matrix of the human cost function. Finally, simulation results on a cooperative shared control driver assistance system are provided to elucidate the feasibility of the developed method.

Inverse linear quadratic dynamic games using partial state observations

Inverse Reinforcement Learning for Identification of Linear-Quadratic Zero-Sum Differential Games

Reinforcement Learning for Inverse Linear-quadratic Dynamic Non-cooperative Games

Inverse linear-quadratic nonzero-sum differential games

Model Based Online Adaptive Inverse Non-Cooperative Linear-Quadratic Differential Games Via Finite-Time Concurrent Learning

Online Inverse Identification of Noncooperative Dynamic Games*

Continuous-time inverse quadratic optimal control problem

Inverse Optimal Control for Linear Quadratic Tracking with Unknown Target States

Network Learning in Quadratic Games from Best-Response Dynamics

Reinforcement Learning for Inverse Non-Cooperative Linear-Quadratic Output-feedback Differential Games

Inverse Optimal Control for Discrete-Time Finite-Horizon Linear Quadratic Regulators.

Inverse reinforcement learning methods for linear differential games

Two person non-zero-sum linear-quadratic differential game with Markovian jumps in infinite horizon

Learning Human Behavior in Shared Control: Adaptive Inverse Differential Game Approach

Identification Methods for Ordinal Potential Differential Games

System Identification Approach for Inverse Optimal Control of Finite-Horizon Linear Quadratic Regulators.

Data-driven Adaptive Dynamic Programming for Partially Observable Nonzero-Sum Games Via Q-learning Method

Linear-Quadratic Dynamic Games as Receding-Horizon Variational Inequalities

A Convex Optimization Approach to Inverse Optimal Control

Statistically consistent inverse optimal control for discrete-time indefinite linear-quadratic systems

A Finite-Horizon Inverse Linear Quadratic Optimal Control Method for Human-in-the-Loop Behavior Learning