Abstract:Mathematical optimization is one of the cornerstones of modern engineering research and practice. Yet, throughout all application domains, mathematical optimization is, for the most part, considered to be a numerical discipline. Optimization problems are formulated to be solved numerically with specific algorithms running on microprocessors. An emerging alternative is to view optimization algorithms as dynamical systems. Besides being insightful in itself, this perspective liberates optimization methods from specific numerical and algorithmic aspects and opens up new possibilities to endow complex real-world systems with sophisticated self-optimizing behavior. Towards this goal, it is necessary to understand how numerical optimization algorithms can be converted into feedback controllers to enable robust "closed-loop optimization". In this article, we focus on recent control designs under the name of "feedback-based optimization" which implement optimization algorithms directly in closed loop with physical systems. In addition to a brief overview of selected continuous-time dynamical systems for optimization, our particular emphasis in this survey lies on closed-loop stability as well as the robust enforcement of physical and operational constraints in closed-loop implementations. To bypass accessing partial model information of physical systems, we further elaborate on fully data-driven and model-free operations. We highlight an emerging application in autonomous reserve dispatch in power systems, where the theory has transitioned to practice by now. We also provide short expository reviews of pioneering applications in communication networks and electricity grids, as well as related research streams, including extremum seeking and pertinent methods from model predictive and process control, to facilitate high-level comparisons with the main topic of this survey.

Data-Driven Design and Optimization of Feedback Control Systems for Industrial Applications

Adaptive Controller and Observer Design for A Class of Nonlinear Systems

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

A Two-stage Optimal Controller for Hydraulic Loading System with Mechanical Compensation

Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

Get the design right, the rest is automatic: Towards an adaptive MPC controller

Controller and Observer Design for Lipschitz Nonlinear Systems

Data-driven Direct Automatic Tuning Scheme for Fixed-Structure Digital Controllers of Hybrid Systems

Data-Driven Design of Two-Degree-Of-Freedom Controllers Using Reinforcement Learning Techniques

An approach to data-driven design of feedback control systems with embedded residual generation.

An Explicit Optimizing Control Approach Based on Output Feedback

Data-driven designs of observers and controllers via solving model matching problems

Combining Data-Driven and Event-Driven for Online Learning Predictive Control in Power Converters

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Data-driven sensor fault diagnosis systems for linear feedback control loops

Optimization Algorithms as Robust Feedback Controllers

An Online Algorithm for Solving Feedback Optimal Control Problems with Partial Observations

Model-Free Nonlinear Feedback Optimization

Data-driven design of fault-tolerant control systems based on recursive stable image representation

Design and Implementation of Lifecycle Management for Industrial Control Applications

Optimal Design of Residual-Driven Dynamic Compensator Using Iterative Algorithms with Guaranteed Convergence