Abstract:In this article, the leader's behavior learning problem is investigated for a class of leader-follower systems, where the leader's behavior is assumed not a priori known to all followers that are autonomous. A multiplayer nonzero-sum differential game is introduced to indicate the control interaction between agents, where the leader's behavior is modeled by an unknown cost function. The autonomous followers aim to retrieve the weighting matrix in the leader's cost function collaboratively. A distributed online adaptive inverse differential game (IDG) approach to the leader's behavior learning is proposed for the autonomous followers. Specifically, a concurrent learning based adaptive law and an interactive game controller are first developed for each autonomous follower to learn the leader's feedback gain matrix online, while the feedback Nash equilibrium of the game can be achieved. Then, a linear matrix inequality optimization problem is formulated to determine the weighting matrix of the leader's cost function for each autonomous follower. The proposed method simply requires that all followers share their interactive feedback gain matrices, not their private intents, and use only the system state data, not both the system state data and the leader's control input data. The main advantages of the proposed method are that it can be implemented online without requiring the persistent excitation condition and needs less computational power for all followers. Finally, numerical simulations are provided to demonstrate the effectiveness and feasibility of the developed method.

Inverse reinforcement learning methods for linear differential games

Inverse Reinforcement Learning for Identification of Linear-Quadratic Zero-Sum Differential Games

Inverse linear-quadratic nonzero-sum differential games

Reinforcement Learning for Inverse Non-Cooperative Linear-Quadratic Output-feedback Differential Games

Reinforcement Learning for Inverse Linear-quadratic Dynamic Non-cooperative Games

Model Based Online Adaptive Inverse Non-Cooperative Linear-Quadratic Differential Games Via Finite-Time Concurrent Learning

Learning Algorithms For Differential Games Of Continuous-Time Systems

Inverse linear quadratic dynamic games using partial state observations

Online Finite-Horizon ADP Algorithm for Solving Non-Cooperative Differential Games

Robust Multi-Agent Differential Games for General Linear Systems with Model Uncertainties

Inverse Reinforcement Learning for Discrete-Time Linear Quadratic Systems

Integral Reinforcement Learning for Linear Continuous-Time Zero-Sum Games With Completely Unknown Dynamics

Policy Iteration Based Q-learning for Linear Nonzero-Sum Quadratic Differential Games.

Inverse Reinforcement Learning with Multiple Ranked Experts

Deep Reinforcement Learning for Nash Equilibrium of Differential Games

Distributed Adaptive Inverse Differential Game Approach to Leader's Behavior Learning for Multiple Autonomous Followers

Learning Human Behavior in Shared Control: Adaptive Inverse Differential Game Approach

Nash Equilibria for Linear Quadratic Discrete-time Dynamic Games via Iterative and Data-driven Algorithms

Online Adaptive Q-learning Method for Fully Cooperative Linear Quadratic Dynamic Games

Online estimation of objective function for continuous-time deterministic systems