Abstract:Science and Engineering applications are typically associated with expensive optimization problems to identify optimal design solutions and states of the system of interest. Bayesian optimization and active learning compute surrogate models through efficient adaptive sampling schemes to assist and accelerate this search task toward a given optimization goal. Both those methodologies are driven by specific infill/learning criteria which quantify the utility with respect to the set goal of evaluating the objective function for unknown combinations of optimization variables. While the two fields have seen an exponential growth in popularity in the past decades, their dualism and synergy have received relatively little attention to date. This paper discusses and formalizes the synergy between Bayesian optimization and active learning as symbiotic adaptive sampling methodologies driven by common principles. In particular, we demonstrate this unified perspective through the formalization of the analogy between the Bayesian infill criteria and active learning criteria as driving principles of both the goal-driven procedures. To support our original perspective, we propose a general classification of adaptive sampling techniques to highlight similarities and differences between the vast families of adaptive sampling, active learning, and Bayesian optimization. Accordingly, the synergy is demonstrated mapping the Bayesian infill criteria with the active learning criteria, and is formalized for searches informed by both a single information source and multiple levels of fidelity. In addition, we provide guidelines to apply those learning criteria investigating the performance of different Bayesian schemes for a variety of benchmark problems to highlight benefits and limitations over mathematical properties that characterize real-world applications.

Application Research of Bayesian Learning Methods in Knowledge System Interoperating Process

Research on Modeling Method of Language Knowledge of Brand Style on Bayesian Network

Incorporating Probabilistic Knowledge into Topic Models.

Using Bayesian Decision for Ontology Mapping.

CARE: Confidence-rich Autonomous Robot Exploration Using Bayesian Kernel Inference and Optimization

Aknowledge Matching Approach Based Onmulticlassification Radial Basis Function Neural Network for Knowledge Push System

The Application of Bayesian Optimization and Classifier Systems in Nurse Scheduling

Bayesian Network Approach to Knowledge Discovery in Traditional Chinese Medicine

Design of Computer-Aided Translation System Based on Naive Bayesian Algorithm

On knowledge based intelligence

Research Progress in Bayesian Program Learning

Research on an advanced intelligence implementation system for engineering process in industrial field under big data

Expert-oriented optimization of knowledge base

Application of Bayesian Networks and Reinforcement Learning in Intelligent Control Systems in Uncertain Environments

Learning Knowledge Graph Embedding in Semantic Space: A Novel Bi-linear Semantic Matching Method

Matching Algorithm Research and Implementation in Intranet Based on Knowledgebase

Active Learning and Bayesian Optimization: a Unified Perspective to Learn with a Goal

Actively Learning Ontology Matching via User Interaction

Genetic Algorithm for Bayesian Knowledge Tracing: A Practical Application.

Integrating Human Expertise in Continuous Spaces: A Novel Interactive Bayesian Optimization Framework with Preference Expected Improvement