Abstract:Mathematical optimization is one of the cornerstones of modern engineering research and practice. Yet, throughout all application domains, mathematical optimization is, for the most part, considered to be a numerical discipline. Optimization problems are formulated to be solved numerically with specific algorithms running on microprocessors. An emerging alternative is to view optimization algorithms as dynamical systems. Besides being insightful in itself, this perspective liberates optimization methods from specific numerical and algorithmic aspects and opens up new possibilities to endow complex real-world systems with sophisticated self-optimizing behavior. Towards this goal, it is necessary to understand how numerical optimization algorithms can be converted into feedback controllers to enable robust "closed-loop optimization". In this article, we focus on recent control designs under the name of "feedback-based optimization" which implement optimization algorithms directly in closed loop with physical systems. In addition to a brief overview of selected continuous-time dynamical systems for optimization, our particular emphasis in this survey lies on closed-loop stability as well as the robust enforcement of physical and operational constraints in closed-loop implementations. To bypass accessing partial model information of physical systems, we further elaborate on fully data-driven and model-free operations. We highlight an emerging application in autonomous reserve dispatch in power systems, where the theory has transitioned to practice by now. We also provide short expository reviews of pioneering applications in communication networks and electricity grids, as well as related research streams, including extremum seeking and pertinent methods from model predictive and process control, to facilitate high-level comparisons with the main topic of this survey.

Revisiting Kinetic Monte Carlo Algorithms for Time-dependent Processes: from open-loop control to feedback control

Time-delayed Feedback Control Optimization for Quasi Linear Systems under Random Excitations

Feedback Control of Nonlinear Stochastic Dynamic Systems for Accurately Tracking a Specified Stationary Probability Density Function

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

On the stabilization of a kinetic model by feedback-like control fields in a Monte Carlo framework

Fast and Accurate Motion Tracking of a Linear Motor System under Kinematic and Dynamic Constraints: an Integrated Planning and Control Approach

${\tt KRAFT}$: Sampling-Based Kinodynamic Replanning and Feedback Control over Approximate, Identified Models of Vehicular Systems

State estimation for control: an approach for output-feedback stochastic MPC

Recent Advances in Path Integral Control for Trajectory Optimization: An Overview in Theoretical and Algorithmic Perspectives

Adaptive Iterative Learning Control for a Class of Nonlinear Strict-Feedback Systems with Unknown State Delays

Kinetic description of optimal control problems and applications to opinion consensus

Data-driven feedback stabilization of nonlinear systems: Koopman-based model predictive control

Using Bayesian Optimization to Design Time Step Size Controllers with Application to Modified Patankar--Runge--Kutta Methods

A Multilevel Approach for Stochastic Nonlinear Optimal Control

Backstepping Control for Nonlinear Systems with Time Delays and Applications to Chemical Reactor Systems

Optimization Algorithms as Robust Feedback Controllers

Stochastic trajectory optimization for mechanical systems with parametric uncertainties

Markov Chain Monte Carlo for Koopman-based Optimal Control: Technical Report

Deterministic Trajectory Optimization through Probabilistic Optimal Control