Neural Predictive Intervals for Simulation Metamodeling.

Henry Lam,Haofeng Zhang
DOI: https://doi.org/10.1109/wsc52266.2021.9715494
2021-01-01
Abstract:Simulation metamodeling refers to the use of lower-fidelity models to represent input-output relations with few simulation runs. Stochastic kriging, which uses Gaussian process and captures both aleatoric and epistemic uncertainties, is a versatile and predominant technique for such a task. However, this approach relies on specific model assumptions and could encounter scalability challenges. In this paper, we study an alternate metamodeling approach using neural-network-based input-output prediction intervals. We cast the metamodeling into an empirical constrained optimization framework to train the neural network that attains accurate prediction in terms of coverage and prediction interval width. We present a validation machinery and show how our method can enjoy a distribution-free finite-sample guarantee on the prediction performance. We demonstrate the superior performance of our method compared with other methods including stochastic kriging through some numerical examples.
What problem does this paper attempt to address?