Abstract:This paper aims to provide new insights into model calibration, which plays an essential role in improving the validity of Modeling and Simulation (M&S) in engineering design and analysis. Various existing model calibration approaches including the direct Bayesian calibration method, the well-known Kennedy and O’Hagan (KOH) framework and its variants, and the optimization-based calibration method, are first investigated. It is observed that the direct Bayesian calibration and optimization-based calibration may be misled by potentially wrong information if the computer model cannot adequately capture the underlying true physics, while the effectiveness of the KOH framework and its variants is significantly affected by the prior distributions of the unknown model parameters. Based on this observation, a sequential model calibration and validation (SeCAV) framework is proposed to improve the efficacy of both model parameter calibration and bias correction for the purpose of uncertainty quantification and reduction. In the proposed method, the model validation and Bayesian calibration are implemented in a sequential manner, where the former serves as a filter to select the best experimental data for the latter, and provides the latter with a confidence probability as a weight factor for updating the uncertain model parameters. The parameter calibration result is then integrated with model bias correction to improve the prediction accuracy of the M&S. A mathematical example and an engineering example are employed to demonstrate the advantages and disadvantages of different approaches. The results show that the SeCAV framework, in general, performs better than the existing methods.

An Uncertainty Calibration Method for Multi-Output Model

A collaborative model calibration framework under uncertainty considering parameter distribution

Two-stage Nested Optimization-Based Uncertainty Propagation Method for Model Calibration.

A Sequential Calibration and Validation Framework for Model Uncertainty Quantification and Reduction

Bayesian Calibration in a multi-output transposition context

Novel Model Calibration Method Via Non-Probabilistic Interval Characterization and Bayesian Theory

A Model Validation Framework Based on Parameter Calibration under Aleatory and Epistemic Uncertainty

An Efficient Bayesian Uncertainty Quantification Approach with Application to K-Ω-γ Transition Modeling

Validation metric for multi-output model with mixed uncertainty of random and interval variables

Bayesian Calibration of Multi-Level Model with Unobservable Distributed Response and Application to Miter Gates

Multi-objective Calibration with Predictive Uncertainty Analysis for Conceptual Hydrological Models

A hybrid framework for improving uncertainty quantification in deep learning-based QSAR regression modeling

Uncertainty quantification in low cycle fatigue life model based on Bayesian theory

Heterogeneous uncertainty quantification using Bayesian inference for simulation-based design optimization

A Nonparametric Bayesian Framework for Uncertainty Quantification in Stochastic Simulation

An Uncertainty Quantification Method for Inexact Simulation Models

Robust Calibration with Multi-domain Temperature Scaling

An Improved Calibration and Uncertainty Analysis Approach Using a Multicriteria Sequential Algorithm for Hydrological Modeling

Multi-output calibration of a honeycomb seal via on-site surrogates

Multi-Head Multi-Loss Model Calibration

Characterising geotechnical model uncertainty by hybrid Markov Chain Monte Carlo simulation