Abstract:This paper develops new insights into quantitative methods for the validation of computational model prediction. Four types of methods are investigated, namely classical and Bayesian hypothesis testing, a reliability-based method, and an area metric-based method. Traditional Bayesian hypothesis testing is extended based on interval hypotheses on distribution parameters and equality hypotheses on probability distributions, in order to validate models with deterministic/stochastic output for given inputs. Two types of validation experiments are considered - fully characterized (all the model/experimental inputs are measured and reported as point values) and partially characterized (some of the model/experimental inputs are not measured or are reported as intervals). Bayesian hypothesis testing can minimize the risk in model selection by properly choosing the model acceptance threshold, and its results can be used in model averaging to avoid Type I/II errors. It is shown that Bayesian interval hypothesis testing, the reliability-based method, and the area metric-based method can account for the existence of directional bias, where the mean predictions of a numerical model may be consistently below or above the corresponding experimental observations. It is also found that under some specific conditions, the Bayes factor metric in Bayesian equality hypothesis testing and the reliability-based metric can both be mathematically related to the p-value metric in classical hypothesis testing. Numerical studies are conducted to apply the above validation methods to gas damping prediction for radio frequency (RF) microelectromechanical system (MEMS) switches. The model of interest is a general polynomial chaos (gPC) surrogate model constructed based on expensive runs of a physics-based simulation model, and validation data are collected from fully characterized experiments.

Structural dynamics model validation based on monte carlo method

Stochastic Validation of Structural FE-models Based on Hierarchical Cluster Analysis and Advanced Monte Carlo Simulation

A Stochastic-Based Method for Finite Element Model Validation

A New Validation Metric for Models with Correlated Responses Using Limited Experimental and Simulation Data

Model Validation Via Uncertainty Propagation and Data Transformations

A Comparative Study of Agent Models Via a MCS Based Stochastic Model Updating Method

Structural modal identification and MCMC-based model updating by a Bayesian approach

A Stochastic Model Updating Strategy-Based Improved Response Surface Model and Advanced Monte Carlo Simulation

A Comprehensive Validation Method with Surface-Surface Comparison for Vehicle Safety Applications

Stochastic Model Updating Using Distance Discrimination Analysis

System Reliability Analysis by Monte Carlo Based Method and Finite Element Structural Models

Random response analysis based model validation and structural optimization of a vibration fixture

Research On Validation Metrics For Multiple Dynamic Response Comparison Under Uncertainty

Comparative Study of Uncertainty Quantification Metrics via a Stochastic Method of Model Validation

An Efficient Reliability Method Combining Adaptive Support Vector Machine and Monte Carlo Simulation

Development and Application of a Reliability-Based Multivariate Model Validation Method

A structural FRF model validation method based on niching genetic algorithm

Advanced markov chain monte carlo approach for structural identification

A Model Validation Method Based on the Orthogonal Polynomial Transformation and Area Metric

Structural Modelling and Bayesian Inference for Model Validation and Confidence Extrapolation

Quantitative model validation techniques: new insights