Abstract:A machine-learning-based framework for modeling the error introduced by surrogate models of parameterized dynamical systems is proposed. The framework entails the use of high-dimensional regression techniques (e.g., random forests, LASSO) to map a large set of inexpensively computed `error indicators' (i.e., features) produced by the surrogate model at a given time instance to a prediction of the surrogate-model error in a quantity of interest (QoI). This eliminates the need for the user to hand-select a small number of informative features. The methodology requires a training set of parameter instances at which the time-dependent surrogate-model error is computed by simulating both the high-fidelity and surrogate models. Using these training data, the method first determines regression-model locality (via classification or clustering), and subsequently constructs a `local' regression model to predict the time-instantaneous error within each identified region of feature space. We consider two uses for the resulting error model: (1) as a correction to the surrogate-model QoI prediction at each time instance, and (2) as a way to statistically model arbitrary functions of the time-dependent surrogate-model error (e.g., time-integrated errors). We apply the proposed framework to model errors in reduced-order models of nonlinear oil--water subsurface flow simulations. The reduced-order models used in this work entail application of trajectory piecewise linearization with proper orthogonal decomposition. When the first use of the method is considered, numerical experiments demonstrate consistent improvement in accuracy in the time-instantaneous QoI prediction relative to the original surrogate model, across a large number of test cases. When the second use is considered, results show that the proposed method provides accurate statistical predictions of the time- and well-averaged errors.

A new approach for data-driven surrogate modelling applied in highly nonlinear engineering functions

A Surrogate Modelling Approach Based on Nonlinear Dimension Reduction for Uncertainty Quantification in Groundwater Flow Models

Advances in surrogate based modeling, feasibility analysis, and optimization: A review

Learning non-stationary and discontinuous functions using clustering, classification and Gaussian process modelling

A New Sequential Sampling Method for Surrogate Modeling Based on a Hybrid Metric

Surrogate-Based Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Structural Error.

A surrogate-based optimization method with RBF neural network enhanced by linear interpolation and hybrid infill strategy

Data efficient surrogate modeling for engineering design: Ensemble-free batch mode deep active learning for regression

Data‐driven decision‐focused surrogate modeling

Two-Stage Surrogate Modeling for Data-Driven Design Optimization with Application to Composite Microstructure Generation

A machine learning-based comparative analysis of surrogate models for design optimisation in computational fluid dynamics

Error modeling for surrogates of dynamical systems using machine learning

Efficient Learning of Accurate Surrogates for Simulations of Complex Systems

A novel learning function for adaptive surrogate-model-based reliability evaluation

Surrogate-Based Simulation Optimization

Variational Bayesian surrogate modelling with application to robust design optimisation

Surrogate data method applied to nonlinear time series

Surrogate-assisted global sensitivity analysis: an overview

Extending classical surrogate modelling to high-dimensions through supervised dimensionality reduction: a data-driven approach

A novel data generation scheme for surrogate modelling with deep operator networks

Active-Learning-Driven Surrogate Modeling for Efficient Simulation of Parametric Nonlinear Systems