Abstract:Active learning provides guidance for the design and modeling of systems with highly expensive sampling costs. However, existing active learning approaches suffer from cold-start concerns, where the performance is impaired due to the initial few experiments designed by active learning. In this paper, we propose using transfer learning to solve the cold-start problem of functional regression by leveraging knowledge from related and data-rich signals to achieve robust and superior performance, especially when only a few experiments are available in the signal of interest. More specifically, we construct a multi-output Gaussian process (MGP) to model the between-signal functional relationship. This MGP features unique innovations that distinguish the proposed transfer active learning from existing works: i) a specially designed covariance structure is proposed for characterizing within-and between-signal inter-relationships and facilitating interpretable transfer learning, and ii) an iterative Bayesian framework is proposed to update the parameters and prediction of the MGP in real-time, which significantly reduces the computational load and facilitates the iterative active learning. The inter-relationship captured by this novel MGP is then fed into active learning using the integrated mean-squared error (IMSE) as the objective. We provide theoretical justifications for this active learning mechanism, which demonstrates the objective (IMSE) is monotonically decreasing as we gather more data from the proposed transfer active learning. The real-time updating and the monotonically decreasing objective together provide both practical efficiency and theoretical guarantees for solving the cold-start concern in active learning. The proposed method is compared with benchmark methods through various numerical and real case studies, and the results demonstrate the superiority of the method, especially when limited experiments are available at the initial stage of design.

Active Learning Methods with Deep Gaussian Processes.

Promoting Active Learning with Mixtures of Gaussian Processes

Active data based Gaussian process models for nonlinear spatiotemporal systems

Intelligent Educational Data Analysis With Gaussian Processes

Active Learning of Gaussian Processes with Manifold-Preserving Graph Reduction

Efficient Active Learning for Gaussian Process Classification by Error Reduction.

Gaussian Process Versus Margin Sampling Active Learning

Active Learning With Gaussian Process Classifier for Hyperspectral Image Classification

Educational And Non-Educational Text Classification Based On Deep Gaussian Processes

Efficient Learning Algorithms for Gaussian Processes

Active Learning for Gaussian Process Considering Uncertainties with Application to Shape Control of Composite Fuselage

Multi-class Multi-annotator Active Learning with Robust Gaussian Process for Visual Recognition

Multi-View Representation Learning with Deep Gaussian Processes

Active Learning for Derivative-Based Global Sensitivity Analysis with Gaussian Processes

A General Non-Parametric Active Learning Framework for Classification on Multiple Manifolds.

A Joint Gaussian Process Model for Active Visual Recognition with Expertise Estimation in Crowdsourcing.

Real-Time Transfer Active Learning for Functional Regression and Prediction Based on Multi-Output Gaussian Process

Enhanced Gaussian Process Regression for Active Learning Model-based Predictive Control

Efficient Model-Free Reinforcement Learning Using Gaussian Process

Sparsity-Aware Distributed Learning for Gaussian Processes with Linear Multiple Kernel

Large Linear Multi-output Gaussian Process Learning