Abstract:In this paper, we propose a novel differential-game based neural network (NN) control architecture to solve an optimal control problem for a class of large-scale nonlinear systems involving N-players. We focus on optimizing the usage of the computational resources along with the system performance simultaneously. In particular, the N-players' control policies are desired to be designed such that they cooperatively optimize the large-scale system performance, and the sampling intervals for each player are desired to reduce the frequency of feedback execution. To develop a unified design framework that achieves both these objectives, we propose an optimal control problem by integrating both the design requirements, which leads to a multi-player differential-game. A solution to this problem is numerically obtained by solving the associated Hamilton-Jacobi (HJ) equation using event-driven approximate dynamic programming (E-ADP) and artificial NNs online and forward-in-time. We employ the critic neural networks to approximate the solution to the HJ equation, i.e., the optimal value function, with aperiodically available feedback information. Using the NN approximated value function, we design the control policies and the sampling schemes. Finally, the event-driven N-player system is remodeled as a hybrid dynamical system with impulsive weight update rules for analyzing its stability and convergence properties. The closed-loop practical stability of the system and Zeno free behavior of the sampling scheme are demonstrated using the Lyapunov method. Simulation results using a numerical example are also included to substantiate the analytical results.

Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism

Adaptive Dynamic Programming for a Nonlinear Two‐Player Non‐Zero‐Sum Differential Game With State and Input Constraints

Event-Triggered Optimal Tracking Control Design with DHP Formulation for Discrete-Time Nonlinear Nonzero-Sum Games

Optimal Mixed Strategies to the Zero-sum Linear Differential Game

Zero-Sum Game-Based Decentralized Optimal Control for Saturated Nonlinear Interconnected Systems via a Data and Event Driven Approach

Event-Triggered Single-Network ADP for Zero-Sum Game of Unknown Nonlinear Systems with Constrained Input

Event-triggered optimal control for discrete-time multi-player non-zero-sum games using parallel control

A Novel Framework for Game-Based Optimal Event-Triggered Control of Multi-Input Nonlinear Systems

An efficient model‐free adaptive optimal control of continuous‐time nonlinear non‐zero‐sum games based on integral reinforcement learning with exploration

Observer-based event-triggered control for zero-sum games of input constrained multi-player nonlinear systems

Dynamic event-triggered robust optimal tracking control for multi-player nonzero-sum games with mismatched uncertainties and asymmetric constrained inputs

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

Advanced optimal tracking integrating a neural critic technique for asymmetric constrained zero-sum games

Differential-game for resource aware approximate optimal control of large-scale nonlinear systems with multiple players

Event-Triggered ADP for Nonzero-Sum Games of Unknown Nonlinear Systems

Neural-network-based safe learning control for non-zero-sum differential games of nonlinear systems with asymmetric input constraints

Multi‐event‐triggered adaptive dynamic programming for non‐zero‐sum game of unknown nonlinear system

Nonzero-Sum Games Using Actor-Critic Neural Networks: A Dynamic Event-Triggered Adaptive Dynamic Programming

Zero-Sum Differential Game-Based Optimal Fault-Tolerant Control for Interconnected Systems with Actuator Faults

Optimal Asymptotic Tracking Control for Nonzero-Sum Differential Game Systems with Unknown Drift Dynamics via Integral Reinforcement Learning

Dynamic Event-Triggered Strategy-Based Optimal Control of Modular Robot Manipulator: A Multiplayer Nonzero-Sum Game Perspective