Abstract:We address the robot grasp optimization problem of unknown objects considering uncertainty in the input space. Grasping unknown objects can be achieved by using a trial and error exploration strategy. Bayesian optimization is a sample efficient optimization algorithm that is especially suitable for this setups as it actively reduces the number of trials for learning about the function to optimize. In fact, this active object exploration is the same strategy that infants do to learn optimal grasps. One problem that arises while learning grasping policies is that some configurations of grasp parameters may be very sensitive to error in the relative pose between the object and robot end-effector. We call these configurations unsafe because small errors during grasp execution may turn good grasps into bad grasps. Therefore, to reduce the risk of grasp failure, grasps should be planned in safe areas. We propose a new algorithm, Unscented Bayesian optimization that is able to perform sample efficient optimization while taking into consideration input noise to find safe optima. The contribution of Unscented Bayesian optimization is twofold as if provides a new decision process that drives exploration to safe regions and a new selection procedure that chooses the optimal in terms of its safety without extra analysis or computational cost. Both contributions are rooted on the strong theory behind the unscented transformation, a popular nonlinear approximation method. We show its advantages with respect to the classical Bayesian optimization both in synthetic problems and in realistic robot grasp simulations. The results highlights that our method achieves optimal and robust grasping policies after few trials while the selected grasps remain in safe regions.

Safe Sim-to-Real Robot Exploration with Constrained Bayesian Optimization

Learning Observation-Based Certifiable Safe Policy for Decentralized Multi-Robot Navigation

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Bayesian Optimization with Safety Constraints: Safe and Automatic Parameter Tuning in Robotics

CARE: Confidence-rich Autonomous Robot Exploration Using Bayesian Kernel Inference and Optimization

SafeAPT: Safe Simulation-to-Real Robot Learning Using Diverse Policies Learned in Simulation

Simulation-Aided Policy Tuning for Black-Box Robot Learning

Event-Triggered Safe Bayesian Optimization on Quadcopters

Efficient Exploration Using Extra Safety Budget in Constrained Policy Optimization

Cautious Bayesian Optimization for Efficient and Scalable Policy Search

Dynamic Subgoal-based Exploration via Bayesian Optimization

Safe Bayesian Optimization for Complex Control Systems via Additive Gaussian Processes

Unscented Bayesian Optimization for Safe Robot Grasping

Safe Guaranteed Exploration for Non-linear Systems

Dream to Explore: Adaptive Simulations for Autonomous Systems

Robotic Control Optimization Through Kernel Selection in Safe Bayesian Optimization

Safeguarded Progress in Reinforcement Learning: Safe Bayesian Exploration for Control Policy Synthesis

Robots that Suggest Safe Alternatives

Auto-Tuned Sim-to-Real Transfer

Safety Correction from Baseline: Towards the Risk-aware Policy in Robotics Via Dual-agent Reinforcement Learning

Safe Risk-averse Bayesian Optimization for Controller Tuning