Abstract:Feedback control synthesis for nonlinear, parameter-dependent fluid flow control problems is considered. The optimal feedback law requires the solution of the Hamilton-Jacobi-Bellman (HJB) PDE suffering the curse of dimensionality. This is mitigated by Model Order Reduction (MOR) techniques, where the system is projected onto a lower-dimensional subspace, over which the feedback synthesis becomes feasible. However, existing MOR methods assume at least one relaxation of generality, that is, the system should be linear, or stable, or deterministic. We propose a MOR method called Statistical POD (SPOD), which is inspired by the Proper Orthogonal Decomposition (POD), but extends to more general systems. Random samples of the original dynamical system are drawn, treating time and initial condition as random variables similarly to possible parameters in the model, and employing a stabilizing closed-loop control. The reduced subspace is chosen to minimize the empirical risk, which is shown to estimate the expected risk of the MOR solution with respect to the distribution of all possible outcomes of the controlled system. This reduced model is then used to compute a surrogate of the feedback control function in the Tensor Train (TT) format that is computationally fast to evaluate online. Using unstable Burgers' and Navier-Stokes equations, it is shown that the SPOD control is more accurate than Linear Quadratic Regulator or optimal control derived from a model reduced onto the standard POD basis, and faster than the direct optimal control of the original system.

A Multilinear HJB-POD Method for the Optimal Control of PDEs on a Tree Structure

A multilinear HJB-POD method for the optimal control of PDEs

Optimal Control for Hybrid Systems Based on Mixed Dynamic Programming

Sequential Linear Quadratic Control of Bilinear Parabolic PDEs Based on POD Model Reduction

POD-based Reduced Order Optimal Control of Parabolic PDE Systems Via Diffusivity-Interior-boundary Actuation

Iterative design of suboptimal feedback control for bilinear parabolic PDE systems

A Gradient-based Kernel Optimization Approach for Parabolic Distributed Parameter Control Systems

Optimal bounds for POD approximations of infinite horizon control problems based on time derivatives

POD Suboptimal Control of Evolution Problems: Theory and Applications

Mixed-Integer Path-Stable Optimisation, with Applications in Model-Predictive Control of Water Systems

Optimal Control of Hybrid Systems Based on Dynamic Programming

A Primal-dual hybrid gradient method for solving optimal control problems and the corresponding Hamilton-Jacobi PDEs

A Primal-Dual Method for Optimal Control and Trajectory Generation in High-Dimensional Systems

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Statistical Proper Orthogonal Decomposition for model reduction in feedback control

Multi-step Heuristic Dynamic Programming for Optimal Control of Nonlinear Discrete-Time Systems.

HJB-RBF Based Approach for the Control of PDEs

Approximating the Stationary Bellman Equation by Hierarchical Tensor Products

Robust feedback control of nonlinear PDEs by numerical approximation of high-dimensional Hamilton-Jacobi-Isaacs equations

Numerical Solution for Classical Optimal Control Problem Governing by Hyperbolic Partial Differential Equation via Galerkin Finite Element-Implicit method with Gradient Projection Method

Multigoal-oriented optimal control problems with nonlinear PDE constraints