Robust data‐driven dynamic optimization using a set‐based gradient estimator

Ali Kashani,Shirin Panahi,Ankush Chakrabarty,Claus Danielson

DOI: https://doi.org/10.1002/oca.3157

2024-06-14

Optimal Control Applications and Methods

Abstract:This paper presents a robust extremum‐seeking control algorithm for unmodeled nonlinear systems with generally non‐convex cost functions. We introduce a novel gradient estimator based on a polyhedral set that characterizes all gradient estimates consistent with the collected data, providing the best performance for the worst‐case scenario by solving a min‐max problem. We apply our algorithm to the problem of a drone, equipped with a gas sensor, autonomously locating the source of gas emissions. This article presents an extremum‐seeking control (ESC) algorithm for unmodeled nonlinear systems with known steady‐state gain and generally non‐convex cost functions with bounded curvature. The main contribution of this article is a novel gradient estimator, which uses a polyhedral set that characterizes all gradient estimates consistent with the collected data. The gradient estimator is posed as a quadratic program, which selects the gradient estimate that provides the best worst‐case convergence of the closed‐loop Lyapunov function. We show that the polyhedral‐based gradient estimator ensures the stability of the closed‐loop system formed by the plant and optimization algorithm. Furthermore, the estimated gradient provably produces the optimal robust convergence. We demonstrate our ESC controller through three benchmark examples and one practical example, which shows our ESC has fast and robust convergence to the optimal equilibrium.

automation & control systems,operations research & management science,mathematics, applied