Abstract:Robotic algorithms typically depend on various parameters, the choice of which significantly affects the robot's performance. While an initial guess for the parameters may be obtained from dynamic models of the robot, parameters are usually tuned manually on the real system to achieve the best performance. Optimization algorithms, such as Bayesian optimization, have been used to automate this process. However, these methods may evaluate unsafe parameters during the optimization process that lead to safety-critical system failures. Recently, a safe Bayesian optimization algorithm, called SafeOpt, has been developed, which guarantees that the performance of the system never falls below a critical value; that is, safety is defined based on the performance function. However, coupling performance and safety is often not desirable in robotics. For example, high-gain controllers might achieve low average tracking error (performance), but can overshoot and violate input constraints. In this paper, we present a generalized algorithm that allows for multiple safety constraints separate from the objective. Given an initial set of safe parameters, the algorithm maximizes performance but only evaluates parameters that satisfy safety for all constraints with high probability. To this end, it carefully explores the parameter space by exploiting regularity assumptions in terms of a Gaussian process prior. Moreover, we show how context variables can be used to safely transfer knowledge to new situations and tasks. We provide a theoretical analysis and demonstrate that the proposed algorithm enables fast, automatic, and safe optimization of tuning parameters in experiments on a quadrotor vehicle.

ECCBO: An Inherently Safe Bayesian Optimization with Embedded Constraint Control for Real-Time Optimization

Safe Sim-to-Real Robot Exploration with Constrained Bayesian Optimization

A Real-Time Optimization Framework for the Time-Varying Economic Environment

Data-driven auto-tuning strategy for RTO-MPC based on Bayesian optimization

Globally Optimal Dynamic Real Time Optimization Without Model Mismatch Between Optimization and Control Layer

Adaptive Bayesian Optimization for High-Precision Motion Systems

Globally Convergent Composite-Step Trust-Region Framework for Model-Based Real-Time Optimization

ARRTOC: Adversarially Robust Real-Time Optimization and Control

Safe Risk-averse Bayesian Optimization for Controller Tuning

A Trust-Region Framework for Real-Time Optimization with Structural Process-Model Mismatch

Bayesian Optimization with Safety Constraints: Safe and Automatic Parameter Tuning in Robotics

Real-time Optimization for Chemical Processes Based on On-Line Modeling of Controlled Variables

Event-Triggered Safe Bayesian Optimization on Quadcopters

Model-Based Reinforcement Learning In Continuous Environments Using Real-Time Constrained Optimization

Constrained Bayesian Optimization with Adaptive Active Learning of Unknown Constraints

Constrained Reinforcement Learning for Dynamic Optimization under Uncertainty

Sufficient Conditions for Feasibility and Optimality of Real-Time Optimization Schemes - II. Implementation Issues

Sufficient Conditions for Feasibility and Optimality of Real-Time Optimization Schemes - I. Theoretical Foundations

The utilization of closed-loop prediction for dynamic real-time optimization

Real-time Nonlinear Model Predictive Control using One-step Optimizations and Reachable Sets

Safe and Efficient Model-free Adaptive Control via Bayesian Optimization