Abstract:$ $This paper addresses the inverse problem for Linear-Quadratic (LQ) nonzero-sum $N$-player differential games, where the goal is to learn parameters of an unknown cost function for the game, called observed, given the demonstrated trajectories that are known to be generated by stationary linear feedback Nash equilibrium laws. Towards this end, using the demonstrated data, a synthesized game needs to be constructed, which is required to be equivalent to the observed game in the sense that the trajectories generated by the equilibrium feedback laws of the $N$ players in the synthesized game are the same as those demonstrated trajectories. We show a model-based algorithm that can accomplish this task using the given trajectories. We then extend this model-based algorithm to a model-free setting to solve the same problem in the case when the system's matrices are unknown. The algorithms combine both inverse optimal control and reinforcement learning methods making extensive use of gradient descent optimization for the latter. The analysis of the algorithm focuses on the proof of its convergence and stability. To further illustrate possible solution characterization, we show how to generate an infinite number of equivalent games, not requiring to run repeatedly the complete algorithm. Simulation results validate the effectiveness of the proposed algorithms.

On the Value of Two-person Zero-sum Linear Quadratic Differential Games

Linear quadratic differential game problems with constrained open-loop controls

Hamilton-Jacobi Equations and Two-Person Zero-Sum Differential Games with Unbounded Controls

On the Value of Linear Quadratic Zero-sum Difference Games with Multiplicative Randomness: Existence and Achievability

Long-Time Behavior of Zero-Sum Linear-Quadratic Stochastic Differential Games

Discrete-Time LQ Stochastic Two-Person Nonzero-Sum Difference Games with Random Coefficients:~Open-Loop Nash Equilibrium

Open-loop and closed-loop solvabilities for zero-sum stochastic linear quadratic differential games of Markovian regime switching system

Two person non-zero-sum linear-quadratic differential game with Markovian jumps in infinite horizon

Stochastic linear-quadratic differential game with Markovian jumps in an infinite horizon

The Equivalence Conditions of Optimal Feedback Control-Strategy Operators for Zero-Sum Linear Quadratic Stochastic Differential Game with Random Coefficients

State Constrained Two Player Differential Games with Decoupled Dynamics

Linear-Quadratic Non-Zero Sum Backward Stochastic Differential Game With Overlapping Information

A kind of linear quadratic non-zero sum differential game of backward stochastic differential equation with asymmetric information

Stackelberg Equilibriums of Open-Loop Differential Games

Open-loop and closed-loop Nash equilibria for the LQ stochastic difference game

Set Values of Dynamic Nonzero Sum Games and Set Valued Hamiltonians

Approximate solution of a zero-sum linear-quadratic differential game by the auxiliary parameter method: analytical/numerical study

Linear-quadratic two-person differential game: Nash game versus Stackelberg game, local information versus global information

Inverse linear-quadratic nonzero-sum differential games

Optimal Mixed Strategies to the Zero-sum Linear Differential Game

Open-loop Pareto-Nash equilibria in multi-objective interval differential games