Abstract:Level set estimation (LSE), the problem of identifying the set of input points where a function takes value above (or below) a given threshold, is important in practical applications. When the function is expensive-to-evaluate and black-box, the \textit{straddle} algorithm, which is a representative heuristic for LSE based on Gaussian process models, and its extensions having theoretical guarantees have been developed. However, many of existing methods include a confidence parameter $\beta^{1/2}_t$ that must be specified by the user, and methods that choose $\beta^{1/2}_t$ heuristically do not provide theoretical guarantees. In contrast, theoretically guaranteed values of $\beta^{1/2}_t$ need to be increased depending on the number of iterations and candidate points, and are conservative and not good for practical performance. In this study, we propose a novel method, the \textit{randomized straddle} algorithm, in which $\beta_t$ in the straddle algorithm is replaced by a random sample from the chi-squared distribution with two degrees of freedom. The confidence parameter in the proposed method has the advantages of not needing adjustment, not depending on the number of iterations and candidate points, and not being conservative. Furthermore, we show that the proposed method has theoretical guarantees that depend on the sample complexity and the number of iterations. Finally, we confirm the usefulness of the proposed method through numerical experiments using synthetic and real data.

Active learning for level set estimation under cost-dependent input uncertainty

Active Learning for Level Set Estimation Using Randomized Straddle Algorithms

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

A Finite-Horizon Approach to Active Level Set Estimation

Uncertainty Sampling Based Active Learning with Diversity Constraint by Sparse Selection.

Performance of uncertainty-based active learning for efficient approximation of black-box functions in materials science

Look-Ahead Acquisition Functions for Bernoulli Level Set Estimation

Adaptive Defective Area Identification in Material Surface Using Active Transfer Learning-based Level Set Estimation

Combined State and Parameter Estimation in Level-Set Methods

Learning Decision-Focused Uncertainty Sets in Robust Optimization

Nonparametric active learning for cost-sensitive classification

Learning the Uncertainty Sets for Control Dynamics via Set Membership: A Non-Asymptotic Analysis

Active Learning Via Sequential Design and Uncertainty Sampling

Robust Transfer Learning for Active Level Set Estimation with Locally Adaptive Gaussian Process Prior

High Dimensional Level Set Estimation with Bayesian Neural Network

UncLe-SLAM: Uncertainty Learning for Dense Neural SLAM

Active Selection of Informative Data for Sequential Quality Enhancement of Soft Sensor Models with Latent Variables

Role of Uncertainty Estimation in Accelerating Materials Development Via Active Learning

A New Active Learning Strategy for Soft Sensor Modeling Based on Feature Reconstruction and Uncertainty Evaluation

Failure-Averse Active Learning for Physics-Constrained Systems

Evidential uncertainty sampling for active learning