Abstract:This study presents a novel model‐free algorithm for obtaining the Nash equilibrium solution of continuous‐time nonlinear non‐zero‐sum games. A new integral HJ equation that can quickly and cooperatively determine the Nash equilibrium strategies of all players and the simultaneous continuous‐time adaptive tuning laws for both critic and actor neural network weights are proposed. The algorithm is also enhanced to reduce the number of auxiliary NNs used in the critic. To reduce the learning time and space occupation, this study presents a novel model‐free algorithm for obtaining the Nash equilibrium solution of continuous‐time nonlinear non‐zero‐sum games. Based on the integral reinforcement learning method, a new integral HJ equation that can quickly and cooperatively determine the Nash equilibrium strategies of all players is proposed. By leveraging the neural network approximation and gradient descent method, simultaneous continuous‐time adaptive tuning laws are provided for both critic and actor neural network weights. These laws facilitate the estimation of the optimal value function and optimal policy without requiring knowledge or identification of the system's dynamics. The closed‐loop system stability and convergence of weights are guaranteed through the Lyapunov analysis. Additionally, the algorithm is enhanced to reduce the number of auxiliary NNs used in the critic. The simulation results for a two‐player non‐zero‐sum game validate the effectiveness of the proposed algorithm.

Nash Tracking Controls Of Multi-Input Nonzero-Sum Game System With Reinforcement Learning

Adaptive Optimal Tracking Controls of Unknown Multi-Input Systems Based on Nonzero-Sum Game Theory

Neural Network Learning Control of Multi-input System with Unknown Dynamics

Data-driven Approximate Optimal Tracking Control Schemes for Unknown Non-Affine Non-Linear Multi-Player Systems Via Adaptive Dynamic Programming

Optimal Tracking Control for Multi-player Non-Zero-Sum Games of Continuous-Time Linear Systems with Unknown Dynamics.

Optimal Tracking Control for Non-Zero-sum Games of Linear Discrete-Time Systems Via Off-Policy Reinforcement Learning

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Multi-H∞ Controls for Unknown Input-Interference Nonlinear System with Reinforcement Learning.

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Optimal Asymptotic Tracking Control for Nonzero-Sum Differential Game Systems with Unknown Drift Dynamics via Integral Reinforcement Learning

Online Optimal Solutions for Multi-Player Nonzero-Sum Game with Completely Unknown Dynamics

Model‐free Adaptive Optimal Control of Continuous‐time Nonlinear Non‐zero‐sum Games Based on Reinforcement Learning

An efficient model‐free adaptive optimal control of continuous‐time nonlinear non‐zero‐sum games based on integral reinforcement learning with exploration

Integral Reinforcement Learning-Based Optimal Control for Nonzero-Sum Games of Multi-Player Input-Constrained Nonlinear Systems

Event‐triggered optimal tracking control of multiplayer unknown nonlinear systems via adaptive critic designs

Event-triggered Adaptive Dynamic Programming for Multi-Player Zero-Sum Games with Unknown Dynamics

Game-Based Backstepping Design for Strict-Feedback Nonlinear Multi-Agent Systems Based on Reinforcement Learning

Discrete-time Online Learning Control for a Class of Unknown Nonaffine Nonlinear Systems Using Reinforcement Learning.

Data-Driven Optimal Control for Multi-Player Non-Zero-Sum Games with Unknown Dynamics