Abstract:The control of industrial processes which can be generally described by nonlinear time-delay interconnected systems is very important. A decentralized control method based on adaptive dynamic programming (ADP) is proposed in this article, which can solve the control and stability problem for nonlinear time-delay interconnected systems using past state data and interconnection information. First, the form of nonlinear interconnected systems with state delay is given. Based on such systems, the subsystems are reconstructed by adding the upper bound of the interconnection part to the cost function. New cost functions are constructed which include a series of Hamilton-Jacobi–Bellman (HJB) equations with Lyapunov-Krasovskii (L-K) function, where the past state data and interconnection information are employed. Then, the control problem can be dealt with by solving the HJB equations. The HJB equations can be solved by the critic learning method based on ADP, where the critic neural networks (NNs) are applied to estimate the optimal cost function. The weights can be calculated by the gradient descent method, and the control law can be obtained. Subsequently, the stability of the closed-loop system is proved in the sense of uniformly ultimately bounded (UUB). Finally, simulation results verify the effectiveness of the proposed method by a nonlinear time-delay interconnected system and two-stage chemical reactors.

On-Line Learning Control for Discrete Nonlinear Systems Via an Improved ADDHP Method

Adaptive Extended State Space Predictive Control for a Kind of Nonlinear Systems.

Neural Network Based Multi-Step Predictive Control for Nonlinear Systems

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Discrete-Time Self-Learning Parallel Control

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Approximately Optimal Control of Discrete-Time Nonlinear Switched Systems Using Globalized Dual Heuristic Programming

A Digital Receding-Horizon Learning Controller for Nonlinear Continuous-time Systems

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

ADP-Based Decentralized Controller Design for Nonlinear Time-Delay Interconnected Systems

Direct Heuristic Dynamic Programming Based on an Improved PID Neural Network

Adaptive Multi-Step Evaluation Design With Stability Guarantee for Discrete-Time Optimal Learning Control

Online Adaptation of Kernel Learning Adaptive Predictive Controller

Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Data-Driven Event-Triggered Adaptive Dynamic Programming Control for Nonlinear Systems with Input Saturation.

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

On Iterative Adaptive Dynamic Programming