Abstract:This paper presents a robust extremum‐seeking control algorithm for unmodeled nonlinear systems with generally non‐convex cost functions. We introduce a novel gradient estimator based on a polyhedral set that characterizes all gradient estimates consistent with the collected data, providing the best performance for the worst‐case scenario by solving a min‐max problem. We apply our algorithm to the problem of a drone, equipped with a gas sensor, autonomously locating the source of gas emissions. This article presents an extremum‐seeking control (ESC) algorithm for unmodeled nonlinear systems with known steady‐state gain and generally non‐convex cost functions with bounded curvature. The main contribution of this article is a novel gradient estimator, which uses a polyhedral set that characterizes all gradient estimates consistent with the collected data. The gradient estimator is posed as a quadratic program, which selects the gradient estimate that provides the best worst‐case convergence of the closed‐loop Lyapunov function. We show that the polyhedral‐based gradient estimator ensures the stability of the closed‐loop system formed by the plant and optimization algorithm. Furthermore, the estimated gradient provably produces the optimal robust convergence. We demonstrate our ESC controller through three benchmark examples and one practical example, which shows our ESC has fast and robust convergence to the optimal equilibrium.

Adaptive Extremum Seeking Control via the RMSprop Optimizer

Extremum Seeking Control Based on Feedback Learning Particle Swarm Optimization Algorithm

Quasi-Newton Extremum Seeking Control Based on Incremental Recursive Identification.

Extremum Seeking Control with Attenuated Steady-State Oscillations

Retrospective Cost-based Extremum Seeking Control with Vanishing Perturbation for Online Output Minimization

Cooperative distributed extremum seeking control for coupled multiagent systems based on distributed identification-gradient tracking

Robust Adaptive Extremum Seeking Control Without Persistence of Excitation: Theory to Experiment

Robust data‐driven dynamic optimization using a set‐based gradient estimator

Model-Free Source Seeking by a Novel Single-Integrator with Attenuating Oscillations and Better Convergence Rate: Robotic Experiments

Distributed Extremum Seeking Control of Networked Large-Scale Systems under Constraints.

Extremum Seeking for Stabilization of Systems Not Affine in Control

Adaptive Extremum Seeking Controller Via Nonlinear Variable Gain for Uncertainty Model Multirotor

Control-Affine Extremum Seeking Control with Attenuating Oscillations: A Lie Bracket Estimation Approach

Extremum-Seeking Action Selection for Accelerating Policy Optimization

Practical Safe Extremum Seeking with Assignable Rate of Attractivity to the Safe Set

A Novel Extremum Seeking Control to Enhance Convergence and Robustness in the Presence of Nonlinear Dynamic Sensors

Extremum Seeking Nonlinear Regulator with Concurrent Uncertainties in Exosystems and Control Directions

Maximum Entropy Reinforcement Learning with Evolution Strategies

Extremum Seeking of General Nonlinear Static Maps: A Time-Delay Approach

The Stochastic Steepest Descent Method for Robust Optimization in Banach Spaces

Adaptive Learning Rates with Maximum Variation Averaging.