Abstract:Active learning provides guidance for the design and modeling of systems with highly expensive sampling costs. However, existing active learning approaches suffer from cold-start concerns, where the performance is impaired due to the initial few experiments designed by active learning. In this paper, we propose using transfer learning to solve the cold-start problem of functional regression by leveraging knowledge from related and data-rich signals to achieve robust and superior performance, especially when only a few experiments are available in the signal of interest. More specifically, we construct a multi-output Gaussian process (MGP) to model the between-signal functional relationship. This MGP features unique innovations that distinguish the proposed transfer active learning from existing works: i) a specially designed covariance structure is proposed for characterizing within-and between-signal inter-relationships and facilitating interpretable transfer learning, and ii) an iterative Bayesian framework is proposed to update the parameters and prediction of the MGP in real-time, which significantly reduces the computational load and facilitates the iterative active learning. The inter-relationship captured by this novel MGP is then fed into active learning using the integrated mean-squared error (IMSE) as the objective. We provide theoretical justifications for this active learning mechanism, which demonstrates the objective (IMSE) is monotonically decreasing as we gather more data from the proposed transfer active learning. The real-time updating and the monotonically decreasing objective together provide both practical efficiency and theoretical guarantees for solving the cold-start concern in active learning. The proposed method is compared with benchmark methods through various numerical and real case studies, and the results demonstrate the superiority of the method, especially when limited experiments are available at the initial stage of design.

Weighted Ensembles for Adaptive Active Learning

Genetic Ensemble of Extreme Learning Machine

Ensemble Gaussian Processes for Online Learning Over Graphs With Adaptivity and Scalability

Amortized Active Learning for Nonparametric Functions

Active Learning Methods with Deep Gaussian Processes.

An Evolution Strategy Assisted by an Ensemble of Local Gaussian Process Models.

Efficiently Computable Safety Bounds for Gaussian Processes in Active Learning

Adaptive Ensemble Learning of Spatiotemporal Processes with Calibrated Predictive Uncertainty: A Bayesian Nonparametric Approach

Promoting Active Learning with Mixtures of Gaussian Processes

Active Learning with Weak Supervision for Gaussian Processes

Deep Active Learning with Adaptive Acquisition

Adaptive Lightweight Regularization Tool for Complex Analytics

Real-Time Transfer Active Learning for Functional Regression and Prediction Based on Multi-Output Gaussian Process

LPLgrad: Optimizing Active Learning Through Gradient Norm Sample Selection and Auxiliary Model Training

Adaptive Sparse Gaussian Process

Meta-Learning Priors for Efficient Online Bayesian Regression

Sparsity-Aware Distributed Learning for Gaussian Processes with Linear Multiple Kernel

Adaptive Robotic Information Gathering via Non-Stationary Gaussian Processes

Local Function Complexity for Active Learning via Mixture of Gaussian Processes

Active Learning of Molecular Data for Task-Specific Objectives

Active Learning Guided by Efficient Surrogate Learners