Abstract:$ $This paper addresses the inverse problem for Linear-Quadratic (LQ) nonzero-sum $N$-player differential games, where the goal is to learn parameters of an unknown cost function for the game, called observed, given the demonstrated trajectories that are known to be generated by stationary linear feedback Nash equilibrium laws. Towards this end, using the demonstrated data, a synthesized game needs to be constructed, which is required to be equivalent to the observed game in the sense that the trajectories generated by the equilibrium feedback laws of the $N$ players in the synthesized game are the same as those demonstrated trajectories. We show a model-based algorithm that can accomplish this task using the given trajectories. We then extend this model-based algorithm to a model-free setting to solve the same problem in the case when the system's matrices are unknown. The algorithms combine both inverse optimal control and reinforcement learning methods making extensive use of gradient descent optimization for the latter. The analysis of the algorithm focuses on the proof of its convergence and stability. To further illustrate possible solution characterization, we show how to generate an infinite number of equivalent games, not requiring to run repeatedly the complete algorithm. Simulation results validate the effectiveness of the proposed algorithms.

Inverse Reinforcement Learning for Identification of Linear-Quadratic Zero-Sum Differential Games

Inverse linear-quadratic nonzero-sum differential games

Reinforcement Learning for Inverse Non-Cooperative Linear-Quadratic Output-feedback Differential Games

Reinforcement Learning for Inverse Linear-quadratic Dynamic Non-cooperative Games

Inverse linear quadratic dynamic games using partial state observations

Inverse reinforcement learning methods for linear differential games

Integral Reinforcement Learning for Linear Continuous-Time Zero-Sum Games With Completely Unknown Dynamics

Linear-quadratic Non-Zero Sum Differential Game for Mean-Field Stochastic Systems with Asymmetric Information

Policy Iteration Based Q-learning for Linear Nonzero-Sum Quadratic Differential Games.

Network Learning in Quadratic Games from Best-Response Dynamics

Reinforcement Learning Based Solution To Two-Player Zero-Sum Game Using Differentiator

Q-Learning for Feedback Nash Strategy of Finite-Horizon Nonzero-Sum Difference Games

A kind of linear quadratic non-zero sum differential game of backward stochastic differential equation with asymmetric information

Two person non-zero-sum linear-quadratic differential game with Markovian jumps in infinite horizon

Model Based Online Adaptive Inverse Non-Cooperative Linear-Quadratic Differential Games Via Finite-Time Concurrent Learning

Robust Zero-Sum Differential Game For Uncertain Nonlinear Systems Via Adaptive Dynamic Programming

Data-Driven Inverse Reinforcement Learning for Expert-Learner Zero-Sum Games

Learning Algorithms For Differential Games Of Continuous-Time Systems

Long-Time Behavior of Zero-Sum Linear-Quadratic Stochastic Differential Games

Event-triggered Adaptive Integral Reinforcement Learning Method for Zero-Sum Differential Games of Nonlinear Systems with Incomplete Known Dynamics

A Solution Of Two-Person Zero Sum Differential Games With Incomplete State Information