Abstract:Regression is a fundamental prediction task common in data-centric engineering applications that involves learning mappings between continuous variables. In many engineering applications (e.g.\ structural health monitoring), feature-label pairs used to learn such mappings are of limited availability which hinders the effectiveness of traditional supervised machine learning approaches. The current paper proposes a methodology for overcoming the issue of data scarcity by combining active learning with hierarchical Bayesian modelling. Active learning is an approach for preferentially acquiring feature-label pairs in a resource-efficient manner. In particular, the current work adopts a risk-informed approach that leverages contextual information associated with regression-based engineering decision-making tasks (e.g.\ inspection and maintenance). Hierarchical Bayesian modelling allow multiple related regression tasks to be learned over a population, capturing local and global effects. The information sharing facilitated by this modelling approach means that information acquired for one engineering system can improve predictive performance across the population. The proposed methodology is demonstrated using an experimental case study. Specifically, multiple regressions are performed over a population of machining tools, where the quantity of interest is the surface roughness of the workpieces. An inspection and maintenance decision process is defined using these regression tasks which is in turn used to construct the active-learning algorithm. The novel methodology proposed is benchmarked against an uninformed approach to label acquisition and independent modelling of the regression tasks. It is shown that the proposed approach has superior performance in terms of expected cost -- maintaining predictive performance while reducing the number of inspections required.

Batch Mode Active Learning for Regression With Expected Model Change.

Maximizing Expected Model Change for Active Learning in Regression

Batch-Mode Active Learning of Gaussian Process Regression with Maximum Model Change

Active Learning for Classification with Maximum Model Change

Black-Box Batch Active Learning for Regression

Active Learning Query Strategies for Linear Regression Based on Efficient Global Optimization

regAL: Python Package for Active Learning of Regression Problems

Active learning with adaptive regularization

Batch Mode Active Learning and Its Application to Medical Image Classification

A Graph-Based Approach for Active Learning in Regression

Bayesian Estimate of Mean Proper Scores for Diversity-Enhanced Active Learning

AL-ELM: One Uncertainty-Based Active Learning Algorithm Using Extreme Learning Machine

Active Learning-Based Optimization of Scientific Experimental Design

Leveraging Variation Theory in Counterfactual Data Augmentation for Optimized Active Learning

Big Learning Expectation Maximization

Optimizing Active Learning for Low Annotation Budgets

Online Active Regression.

Active learning for regression in engineering populations: A risk-informed approach

Data efficient surrogate modeling for engineering design: Ensemble-free batch mode deep active learning for regression

MaxiMin Active Learning in Overparameterized Model Classes}

Evolutionary Selection Extreme Learning Machine Optimization for Regression.