Abstract:Highly dissipative nonlinear partial differential equations (PDEs) are widely employed to describe the system dynamics of industrial spatially distributed processes (SDPs). In this paper, we consider the optimal control problem of the general highly dissipative SDPs, and propose an adaptive optimal control approach based on neuro-dynamic programming (NDP). Initially, Karhunen-Loève decomposition is employed to compute empirical eigenfunctions (EEFs) of the SDP based on the method of snapshots. These EEFs together with singular perturbation technique are then used to obtain a finite-dimensional slow subsystem of ordinary differential equations that accurately describes the dominant dynamics of the PDE system. Subsequently, the optimal control problem is reformulated on the basis of the slow subsystem, which is further converted to solve a Hamilton-Jacobi-Bellman (HJB) equation. HJB equation is a nonlinear PDE that has proven to be impossible to solve analytically. Thus, an adaptive optimal control method is developed via NDP that solves the HJB equation online using neural network (NN) for approximating the value function; and an online NN weight tuning law is proposed without requiring an initial stabilizing control policy. Moreover, by involving the NN estimation error, we prove that the original closed-loop PDE system with the adaptive optimal control policy is semiglobally uniformly ultimately bounded. Finally, the developed method is tested on a nonlinear diffusion-convection-reaction process and applied to a temperature cooling fin of high-speed aerospace vehicle, and the achieved results show its effectiveness.

Heuristic Dynamic Programming Algorithm for Optimal Control Design of Linear Continuous-Time Hyperbolic PDE Systems

Optimal Control for Hybrid Systems Based on Mixed Dynamic Programming

Iterative design of suboptimal feedback control for bilinear parabolic PDE systems

Sequential Linear Quadratic Control of Bilinear Parabolic PDEs Based on POD Model Reduction

Online Policy Iteration Algorithm for Optimal Control of Linear Hyperbolic PDE Systems

Adaptive Optimal Control of Highly Dissipative Nonlinear Spatially Distributed Processes with Neuro-Dynamic Programming

Stability analysis of heuristic dynamic programming algorithm for nonlinear systems.

Approximate dynamic programming for continuous state and control problems

Intelligent Optimal Control of Constrained Nonlinear Systems Via Receding-Horizon Heuristic Dynamic Programming

H<inf>&#x221E;</inf> Control of Unknown Discrete-Time Nonlinear Systems with Control Constraints Using Adaptive Dynamic Programming

Optimal control laws for time-delay systems with saturating actuators based on heuristic dynamic programming

Distributed Fuzzy Control Design of Nonlinear Hyperbolic PDE Systems with Application to Nonisothermal Plug-Flow Reactor

Supplementary heuristic dynamic programming for wastewater treatment process control

Linear Quadratic Optimal Control for Systems Governed by First-Order Hyperbolic Partial Differential Equations

A Dynamic Robust Control Approach of Hyperbolic Nonlinear PDE Systems

Near-optimal control laws based on Heuristic Dynamic Programming iteration algorithm

Adaptive Dynamics Programming for H∞ Control of Continuous-Time Unknown Nonlinear Systems Via Generalized Fuzzy Hyperbolic Models

Model‐Free H∞ Control Design for Unknown Continuous‐Time Linear System Using Adaptive Dynamic Programming

An Adaptive Dynamic Programming Scheme for Nonlinear Optimal Control With Unknown Dynamics and Its Application to Turbofan Engines

Optimal Control For Boiler Combustion System Based On Iterative Heuristic Dynamic Programming