Abstract:Regression is a fundamental prediction task common in data-centric engineering applications that involves learning mappings between continuous variables. In many engineering applications (e.g.\ structural health monitoring), feature-label pairs used to learn such mappings are of limited availability which hinders the effectiveness of traditional supervised machine learning approaches. The current paper proposes a methodology for overcoming the issue of data scarcity by combining active learning with hierarchical Bayesian modelling. Active learning is an approach for preferentially acquiring feature-label pairs in a resource-efficient manner. In particular, the current work adopts a risk-informed approach that leverages contextual information associated with regression-based engineering decision-making tasks (e.g.\ inspection and maintenance). Hierarchical Bayesian modelling allow multiple related regression tasks to be learned over a population, capturing local and global effects. The information sharing facilitated by this modelling approach means that information acquired for one engineering system can improve predictive performance across the population. The proposed methodology is demonstrated using an experimental case study. Specifically, multiple regressions are performed over a population of machining tools, where the quantity of interest is the surface roughness of the workpieces. An inspection and maintenance decision process is defined using these regression tasks which is in turn used to construct the active-learning algorithm. The novel methodology proposed is benchmarked against an uninformed approach to label acquisition and independent modelling of the regression tasks. It is shown that the proposed approach has superior performance in terms of expected cost -- maintaining predictive performance while reducing the number of inspections required.

Active Regression with Adaptive Huber Loss

Robust twin support vector regression based on Huber loss function

Robust Regularized Kernel Regression.

Active Learning for Regression based on Wasserstein distance and GroupSort Neural Networks

Robust Support Vector Regression in Primal with Asymmetric Huber Loss

A Graph-Based Approach for Active Learning in Regression

On Regularization Based Twin Support Vector Regression with Huber Loss

Robust Hessian Locally Linear Embedding Techniques for High-Dimensional Data

Neural Active Learning on Heteroskedastic Distributions

Active learning with adaptive regularization

Robust Fused Lasso Penalized Huber Regression with Nonasymptotic Property and Implementation Studies

Multi-output Regression on the Output Manifold

Functional Adaptive Huber Linear Regression

Regularized Adaptive Huber Matrix Regression and Distributed Learning

Robust Multi-View Learning Via Adaptive Regression

Robust online active learning

Active learning for regression in engineering populations: A risk-informed approach

Gradient-based bilevel optimization for multi-penalty Ridge regression through matrix differential calculus

Transfer Learning for High Dimensional Robust Regression

Adaptive Huber Regression on Markov-dependent Data

Robust Regression via Mutivariate Regression Depth