Abstract:In this paper, we propose a novel differential-game based neural network (NN) control architecture to solve an optimal control problem for a class of large-scale nonlinear systems involving N-players. We focus on optimizing the usage of the computational resources along with the system performance simultaneously. In particular, the N-players' control policies are desired to be designed such that they cooperatively optimize the large-scale system performance, and the sampling intervals for each player are desired to reduce the frequency of feedback execution. To develop a unified design framework that achieves both these objectives, we propose an optimal control problem by integrating both the design requirements, which leads to a multi-player differential-game. A solution to this problem is numerically obtained by solving the associated Hamilton-Jacobi (HJ) equation using event-driven approximate dynamic programming (E-ADP) and artificial NNs online and forward-in-time. We employ the critic neural networks to approximate the solution to the HJ equation, i.e., the optimal value function, with aperiodically available feedback information. Using the NN approximated value function, we design the control policies and the sampling schemes. Finally, the event-driven N-player system is remodeled as a hybrid dynamical system with impulsive weight update rules for analyzing its stability and convergence properties. The closed-loop practical stability of the system and Zeno free behavior of the sampling scheme are demonstrated using the Lyapunov method. Simulation results using a numerical example are also included to substantiate the analytical results.

Model-free adaptive optimal control for nonlinear multiplayer games with input disturbances

Event‐triggered optimal tracking control of multiplayer unknown nonlinear systems via adaptive critic designs

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Dynamic event-triggered robust optimal tracking control for multi-player nonzero-sum games with mismatched uncertainties and asymmetric constrained inputs

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization

Neural network-based adaptive optimal containment control for non-affine nonlinear multi-agent systems within an identifier-actor-critic framework

Online Reinforcement Learning Neural Network Controller Design for Nanomanipulation

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Event-triggered Optimal Control of Completely Unknown Nonlinear Systems Via Identifier-Critic Learning

Output Feedback Adaptive Optimal Control of Affine Nonlinear systems with a Linear Measurement Model

Adaptive Optimal Output-Feedback Consensus Tracking Control of Nonlinear Multiagent Systems Using Two-Player Stackelberg Game

Asynchronous learning for actor-critic neural networks and synchronous triggering for multiplayer system

Adaptive optimal control of affine nonlinear systems via identifier-critic neural network approximation with relaxed PE conditions

Robust Adaptive Critic Control Design with Network-Based Event-Triggered Formulation

Differential-game for resource aware approximate optimal control of large-scale nonlinear systems with multiple players