Abstract:Mathematical optimization is one of the cornerstones of modern engineering research and practice. Yet, throughout all application domains, mathematical optimization is, for the most part, considered to be a numerical discipline. Optimization problems are formulated to be solved numerically with specific algorithms running on microprocessors. An emerging alternative is to view optimization algorithms as dynamical systems. Besides being insightful in itself, this perspective liberates optimization methods from specific numerical and algorithmic aspects and opens up new possibilities to endow complex real-world systems with sophisticated self-optimizing behavior. Towards this goal, it is necessary to understand how numerical optimization algorithms can be converted into feedback controllers to enable robust "closed-loop optimization". In this article, we focus on recent control designs under the name of "feedback-based optimization" which implement optimization algorithms directly in closed loop with physical systems. In addition to a brief overview of selected continuous-time dynamical systems for optimization, our particular emphasis in this survey lies on closed-loop stability as well as the robust enforcement of physical and operational constraints in closed-loop implementations. To bypass accessing partial model information of physical systems, we further elaborate on fully data-driven and model-free operations. We highlight an emerging application in autonomous reserve dispatch in power systems, where the theory has transitioned to practice by now. We also provide short expository reviews of pioneering applications in communication networks and electricity grids, as well as related research streams, including extremum seeking and pertinent methods from model predictive and process control, to facilitate high-level comparisons with the main topic of this survey.

On Optimized Feedback Control and the Robustification of Opimal Controls

State feedback stabilization of uncertain discrete linear impulsive systems

Optimization Algorithms as Robust Feedback Controllers

On robust feedback for systems with multidimensional control

Optimal control of conditioned processes with feedback controls

Robust control of a class of non-affine nonlinear systems by state and output feedback

Robust and optimal control

Low-Gain Stabilizers for Linear-Convex Optimal Steady-State Control

Generating a robustly stabilizable class of nonlinear systems for the converse optimality problem

Robust Output Feedback of Nonlinear Systems through the Efficient Solution of Min-Max Optimization Problems

Stability of Dynamic Feedback Optimization with Applications to Power Systems

Robust Control of Nonlinear Discrete Systems With Perturbations Based on Estimated State Feedback

An Optimal Feedback Approach for the Stabilization of Linear Systems Subject to Input Saturation and Magnitude-Bounded Disturbances

The Finite-Time Turnpike Phenomenon for Optimal Control Problems: Stabilization by Non-Smooth Tracking Terms

Finite-Time Stabilization and Optimal Feedback Control for Nonlinear Discrete-Time Systems

Nonlinear Optimal Control for Stochastic Dynamical Systems

An Algorithm for Robust-Control System-Design

Improving Robust Model Predictive Control Via Dynamic Output Feedback

Optimal Control for a Class of Chaotic Systems.

Performance-Robustness Tradeoffs in Adversarially Robust Control and Estimation

On Feedback Control of Linear Stochastic Systems