Abstract:In this paper, we propose a novel differential-game based neural network (NN) control architecture to solve an optimal control problem for a class of large-scale nonlinear systems involving N-players. We focus on optimizing the usage of the computational resources along with the system performance simultaneously. In particular, the N-players' control policies are desired to be designed such that they cooperatively optimize the large-scale system performance, and the sampling intervals for each player are desired to reduce the frequency of feedback execution. To develop a unified design framework that achieves both these objectives, we propose an optimal control problem by integrating both the design requirements, which leads to a multi-player differential-game. A solution to this problem is numerically obtained by solving the associated Hamilton-Jacobi (HJ) equation using event-driven approximate dynamic programming (E-ADP) and artificial NNs online and forward-in-time. We employ the critic neural networks to approximate the solution to the HJ equation, i.e., the optimal value function, with aperiodically available feedback information. Using the NN approximated value function, we design the control policies and the sampling schemes. Finally, the event-driven N-player system is remodeled as a hybrid dynamical system with impulsive weight update rules for analyzing its stability and convergence properties. The closed-loop practical stability of the system and Zeno free behavior of the sampling scheme are demonstrated using the Lyapunov method. Simulation results using a numerical example are also included to substantiate the analytical results.

Neural network-based near-optimal control for nonlinear discrete-time zero-sum differential games associated with the H∞ control problem

Neural-network-based safe learning control for non-zero-sum differential games of nonlinear systems with asymmetric input constraints

Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism

Neural-network-based Zero-Sum Game for Discrete-Time Nonlinear Systems Via Iterative Adaptive Dynamic Programming Algorithm

Adaptive Dynamic Programming for a Nonlinear Two‐Player Non‐Zero‐Sum Differential Game With State and Input Constraints

Optimal H∞ Tracking Control of Nonlinear Systems with Zero-Equilibrium-free Via Novel Adaptive Critic Designs.

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

An efficient model‐free adaptive optimal control of continuous‐time nonlinear non‐zero‐sum games based on integral reinforcement learning with exploration

Differential-game for resource aware approximate optimal control of large-scale nonlinear systems with multiple players

Neural network-based finite-horizon optimal control of uncertain affine nonlinear discrete-time systems

Min–max adaptive dynamic programming for zero-sum differential games

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Zero-Sum Differential Game-Based Fault-Tolerant Control for a Class of Affine Nonlinear Systems

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Zero-Sum Game-Based Decentralized Optimal Control for Saturated Nonlinear Interconnected Systems via a Data and Event Driven Approach

Neural-Network-Based Online HJB Solution for Optimal Robust Guaranteed Cost Control of Continuous-Time Uncertain Nonlinear Systems

Advanced optimal tracking integrating a neural critic technique for asymmetric constrained zero-sum games

Event-Triggered Single-Network ADP for Zero-Sum Game of Unknown Nonlinear Systems with Constrained Input

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

Event-driven H ∞ control with critic learning for nonlinear systems

Robust Approximate Dynamic Programming for Nonlinear Systems With Both Model Error and External Disturbance