Abstract:Mathematical optimization is one of the cornerstones of modern engineering research and practice. Yet, throughout all application domains, mathematical optimization is, for the most part, considered to be a numerical discipline. Optimization problems are formulated to be solved numerically with specific algorithms running on microprocessors. An emerging alternative is to view optimization algorithms as dynamical systems. Besides being insightful in itself, this perspective liberates optimization methods from specific numerical and algorithmic aspects and opens up new possibilities to endow complex real-world systems with sophisticated self-optimizing behavior. Towards this goal, it is necessary to understand how numerical optimization algorithms can be converted into feedback controllers to enable robust "closed-loop optimization". In this article, we focus on recent control designs under the name of "feedback-based optimization" which implement optimization algorithms directly in closed loop with physical systems. In addition to a brief overview of selected continuous-time dynamical systems for optimization, our particular emphasis in this survey lies on closed-loop stability as well as the robust enforcement of physical and operational constraints in closed-loop implementations. To bypass accessing partial model information of physical systems, we further elaborate on fully data-driven and model-free operations. We highlight an emerging application in autonomous reserve dispatch in power systems, where the theory has transitioned to practice by now. We also provide short expository reviews of pioneering applications in communication networks and electricity grids, as well as related research streams, including extremum seeking and pertinent methods from model predictive and process control, to facilitate high-level comparisons with the main topic of this survey.

Stability of Dynamic Feedback Optimization with Applications to Power Systems

Stabilisation of Nonlinear Chemical Processes Via Dynamic Power-Shaping Passivity-Based Control.

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

Boundary Stabilization of a Class of Reaction–advection–diffusion Systems Via a Gradient-Based Optimization Approach

Iterative design of suboptimal feedback control for bilinear parabolic PDE systems

Optimization Algorithms as Robust Feedback Controllers

Model-Free Nonlinear Feedback Optimization

Decentralized Feedback Optimization via Sensitivity Decoupling: Stability and Sub-optimality

Online Optimization of LTI Systems Under Persistent Attacks: Stability, Tracking, and Robustness

Feedback Control Optimization for Stochastic Dynamic Systems under Wide-Band Random Excitations

A Hybrid Dynamic Optimization Approach for Stability Constrained Optimal Power Flow

An Efficient Optimal Control Method for Open-Loop Transient Stability Emergency Control

Nonlinear Optimal Control for Stochastic Dynamical Systems

Online Feedback Optimization over Networks: A Distributed Model-free Approach

Online Feedback Optimization and Singular Perturbation via Contraction Theory

Robust Dynamic Feedback Stabilization for Linear Systems with Disturbances

On Optimized Feedback Control and the Robustification of Opimal Controls

Low-Gain Stabilizers for Linear-Convex Optimal Steady-State Control

A method for the optimization of nonlinear systems with delays that guarantees stability and robustness

Stochastic Optimization of Large-Scale Parametrized Dynamical Systems

Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems