Abstract:A machine-learning-based framework for modeling the error introduced by surrogate models of parameterized dynamical systems is proposed. The framework entails the use of high-dimensional regression techniques (e.g., random forests, LASSO) to map a large set of inexpensively computed `error indicators' (i.e., features) produced by the surrogate model at a given time instance to a prediction of the surrogate-model error in a quantity of interest (QoI). This eliminates the need for the user to hand-select a small number of informative features. The methodology requires a training set of parameter instances at which the time-dependent surrogate-model error is computed by simulating both the high-fidelity and surrogate models. Using these training data, the method first determines regression-model locality (via classification or clustering), and subsequently constructs a `local' regression model to predict the time-instantaneous error within each identified region of feature space. We consider two uses for the resulting error model: (1) as a correction to the surrogate-model QoI prediction at each time instance, and (2) as a way to statistically model arbitrary functions of the time-dependent surrogate-model error (e.g., time-integrated errors). We apply the proposed framework to model errors in reduced-order models of nonlinear oil--water subsurface flow simulations. The reduced-order models used in this work entail application of trajectory piecewise linearization with proper orthogonal decomposition. When the first use of the method is considered, numerical experiments demonstrate consistent improvement in accuracy in the time-instantaneous QoI prediction relative to the original surrogate model, across a large number of test cases. When the second use is considered, results show that the proposed method provides accurate statistical predictions of the time- and well-averaged errors.

A new uncertain linear regression model based on equation deformation

A 2-Dimensional Linear Non-minimum Phase Estimator Based on Dynamic Exceeded Regressor

Uncertain Regression Analysis: an Approach for Imprecise Observations

Estimating Unknown Parameters and Disturbance Term in Uncertain Regression Models by the Principle of Least Squares

Multivariate uncertain regression model with imprecise observations

Strategies for constructing mathematical models of nonlinear systems based on multiple linear regression models

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Residual and Confidence Interval for Uncertain Regression Model with Imprecise Observations.

Linear regression models with general distortion measurement errors

Least absolute deviations for uncertain multivariate regression model

Deformation Analysis and Prediction of a High-Speed Railway Suspension Bridge under Multi-Load Coupling

Regularized Nonlinear Regression with Dependent Errors and its Application to a Biomechanical Model

Uncertain Maximum Likelihood Estimation with Application to Uncertain Regression Analysis

An algebraic-geometric approach for linear regression without correspondences

A one-step method for modelling longitudinal data with differential equations

A Least Squares Ensemble Model Based on Regularization and Augmentation Strategy

Least squares parameter estimation for uncertain fractional differential equations and application to stock model

A new penalized least absolute deviation model for high dimensional sparse linear regression and an efficient sequential linear programming algorithm

Residual analysis and parameter estimation of uncertain differential equations

Error modeling for surrogates of dynamical systems using machine learning

The linearized alternating direction method of multipliers for low-rank and fused LASSO matrix regression model