Abstract:The control of industrial processes which can be generally described by nonlinear time-delay interconnected systems is very important. A decentralized control method based on adaptive dynamic programming (ADP) is proposed in this article, which can solve the control and stability problem for nonlinear time-delay interconnected systems using past state data and interconnection information. First, the form of nonlinear interconnected systems with state delay is given. Based on such systems, the subsystems are reconstructed by adding the upper bound of the interconnection part to the cost function. New cost functions are constructed which include a series of Hamilton-Jacobi–Bellman (HJB) equations with Lyapunov-Krasovskii (L-K) function, where the past state data and interconnection information are employed. Then, the control problem can be dealt with by solving the HJB equations. The HJB equations can be solved by the critic learning method based on ADP, where the critic neural networks (NNs) are applied to estimate the optimal cost function. The weights can be calculated by the gradient descent method, and the control law can be obtained. Subsequently, the stability of the closed-loop system is proved in the sense of uniformly ultimately bounded (UUB). Finally, simulation results verify the effectiveness of the proposed method by a nonlinear time-delay interconnected system and two-stage chemical reactors.

Data-Based Adaptive Dynamic Programming for a Class of Discrete-Time Systems with Multiple Delays

Data-Driven Event-Triggered Adaptive Dynamic Programming Control for Nonlinear Systems with Input Saturation.

On Iterative Adaptive Dynamic Programming

Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems

Robust Optimal Control For Time-Delay Systems With Dynamic Uncertainties Via Adp

Adaptive dynamic programming-based optimal control for nonlinear state constrained systems with input delay

ADP-Based Decentralized Controller Design for Nonlinear Time-Delay Interconnected Systems

Adaptive Dynamic Programming and Cooperative Output Regulation of Discrete-time Multi-agent Systems

Time Delay System Tracking Control Based on ADP Iterative Algorithm

A Time-Delay Modeling Approach for Data-Driven Predictive Control of Continuous-Time Systems

Adaptive Dynamic Programming Based on Multi-dimensional Taylor Network for Time-Delay Nonlinear System with Uncertainties

Adaptive Dynamic Programming for Control: A Survey and Recent Advances

Output Constrained Adaptive Dynamic Programming For Continuous-Time Nonlinear Systems

Data‐driven control of dynamic event‐triggered systems with delays

Approximate dynamic programming for continuous state and control problems

A New Delay System Approach to Network-Based Control.

Adaptive Dynamic Programming for a Class of Complex-Valued Nonlinear Systems

Constrained Decoupling Adaptive Dynamic Programming for A Partially Uncontrollable Time-Delayed Model of Energy Systems

Data‐based robust optimal control of discrete‐time systems with uncertainties via adaptive dynamic programming

Adaptive Control for A Class of Discrete-Time Time-Delay Systems with Regard to Delay Parameter

Policy Gradient Adaptive Dynamic Programming for Data-Based Optimal Control.