Abstract:Robotic algorithms typically depend on various parameters, the choice of which significantly affects the robot's performance. While an initial guess for the parameters may be obtained from dynamic models of the robot, parameters are usually tuned manually on the real system to achieve the best performance. Optimization algorithms, such as Bayesian optimization, have been used to automate this process. However, these methods may evaluate unsafe parameters during the optimization process that lead to safety-critical system failures. Recently, a safe Bayesian optimization algorithm, called SafeOpt, has been developed, which guarantees that the performance of the system never falls below a critical value; that is, safety is defined based on the performance function. However, coupling performance and safety is often not desirable in robotics. For example, high-gain controllers might achieve low average tracking error (performance), but can overshoot and violate input constraints. In this paper, we present a generalized algorithm that allows for multiple safety constraints separate from the objective. Given an initial set of safe parameters, the algorithm maximizes performance but only evaluates parameters that satisfy safety for all constraints with high probability. To this end, it carefully explores the parameter space by exploiting regularity assumptions in terms of a Gaussian process prior. Moreover, we show how context variables can be used to safely transfer knowledge to new situations and tasks. We provide a theoretical analysis and demonstrate that the proposed algorithm enables fast, automatic, and safe optimization of tuning parameters in experiments on a quadrotor vehicle.

Local Bayesian optimization for controller tuning with crash constraints

Safe Sim-to-Real Robot Exploration with Constrained Bayesian Optimization

Safe Risk-averse Bayesian Optimization for Controller Tuning

Adaptive Bayesian Optimization for High-Precision Motion Systems

Process Quality Control Through Bayesian Optimization with Adaptive Local Convergence

Improving Computational Cost of Bayesian Optimization for Controller Tuning with a Multi-stage Tuning Framework

Violation-aware contextual Bayesian optimization for controller performance optimization with unmodeled constraints

VABO: Violation-Aware Bayesian Optimization for Closed-Loop Control Performance Optimization with Unmodeled Constraints

High-dimensional Bayesian optimization using low-dimensional feature spaces

Safe Bayesian Optimization for Complex Control Systems via Additive Gaussian Processes

Classified Regression for Bayesian Optimization: Robot Learning with Unknown Penalties

Event-Triggered Safe Bayesian Optimization on Quadcopters

Bayesian Optimization with Safety Constraints: Safe and Automatic Parameter Tuning in Robotics

Optimizing Closed-Loop Performance with Data from Similar Systems: A Bayesian Meta-Learning Approach

Data-efficient Auto-tuning with Bayesian Optimization: An Industrial Control Study

Safety-Aware Cascade Controller Tuning Using Constrained Bayesian Optimization

Robotic Control Optimization Through Kernel Selection in Safe Bayesian Optimization

Automatic Tuning of Robust Model Predictive Control in Iterative Tasks Using Efficient Bayesian Optimization

Kalman Filter Tuning with Bayesian Optimization

Simulation Based Bayesian Optimization

MPC Controller Tuning using Bayesian Optimization Techniques