Abstract:The control of industrial processes which can be generally described by nonlinear time-delay interconnected systems is very important. A decentralized control method based on adaptive dynamic programming (ADP) is proposed in this article, which can solve the control and stability problem for nonlinear time-delay interconnected systems using past state data and interconnection information. First, the form of nonlinear interconnected systems with state delay is given. Based on such systems, the subsystems are reconstructed by adding the upper bound of the interconnection part to the cost function. New cost functions are constructed which include a series of Hamilton-Jacobi–Bellman (HJB) equations with Lyapunov-Krasovskii (L-K) function, where the past state data and interconnection information are employed. Then, the control problem can be dealt with by solving the HJB equations. The HJB equations can be solved by the critic learning method based on ADP, where the critic neural networks (NNs) are applied to estimate the optimal cost function. The weights can be calculated by the gradient descent method, and the control law can be obtained. Subsequently, the stability of the closed-loop system is proved in the sense of uniformly ultimately bounded (UUB). Finally, simulation results verify the effectiveness of the proposed method by a nonlinear time-delay interconnected system and two-stage chemical reactors.

On Iterative Adaptive Dynamic Programming

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Adaptive Predictive Functional Control for a Class of Nonlinear Systems

Adaptive dynamic programming-based optimal control for nonlinear state constrained systems with input delay

Time Delay System Tracking Control Based on ADP Iterative Algorithm

Adaptive Intelligent Control of Nonaffine Nonlinear Time-Delay Systems With Dynamic Uncertainties

High-Precision Quick Control in Multivariable Time-Varying Nonlinear System: A Biological Decision Model Predictive Control Algorithm

Adaptive Dynamic Programming Based on Parallel Control Theory for Underwater Vehicles.

H ∞ optimal control of unknown linear systems by adaptive dynamic programming with applications to time‐delay systems

Online Adaptation of Kernel Learning Adaptive Predictive Controller

Finite-time adaptive dynamic programming control for nonlinear systems based on novel complementary terminal sliding mode surface

A Novel Approximate Dynamic Programming Structure for Optimal Control of Discrete-Time Time-Varying Nonlinear Systems

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

Delay-dependent Controller Design for Networked Control Systems with Long Time Delays: an Iterative LMI Method

Robust Adaptive Iterative Learning Control for Discrete-Time Nonlinear Systems With Time-Iteration-Varying Parameters.

Discrete-Time Self-Learning Parallel Control

A brief survey on nonlinear control using adaptive dynamic programming under engineering-oriented complexities

Adaptive dynamic programming for optimal control of discrete‐time nonlinear system with state constraints based on control barrier function

Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems

Adaptive neural dynamic surface control for nonstrict feedback systems with state delays

ADP-Based Decentralized Controller Design for Nonlinear Time-Delay Interconnected Systems