Abstract:Discrete-event simulation models generate random variates from input distributions and compute outputs according to the simulation logic. The input distributions are typically fitted to finite real-world data and thus are subject to estimation errors that can propagate to the simulation outputs: an issue commonly known as input uncertainty (IU). This paper investigates quantifying IU using the output confidence intervals (CIs) computed from bootstrap quantile estimators. The standard direct bootstrap method has overcoverage due to convolution of the simulation error and IU; however, the brute-force way of washing away the former is computationally demanding. We present two new bootstrap methods to enhance direct resampling in both statistical and computational efficiencies using shrinkage strategies to down-scale the variabilities encapsulated in the CIs. Our asymptotic analysis shows how both approaches produce tight CIs accounting for IU under limited input data and simulation effort along with the simulation sample-size requirements relative to the input data size. We demonstrate performances of the shrinkage strategies with several numerical experiments and investigate the conditions under which each method performs well. We also show advantages of nonparametric approaches over parametric bootstrap when the distribution family is misspecified and over metamodel approaches when the dimension of the distribution parameters is high. History: Accepted by Bruno Tuffin, Area Editor for Simulation. Funding: This work was supported by the National Science Foundation [CAREER CMMI-1834710, CAREER CMMI-2045400, DMS-1854659, and IIS-1849280]. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2022.0044 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2022.0044 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .

Reducing Variance in a Crossdocking Simulation Model Using Common Random Numbers and Antithetic Variates

Investigating the Effectiveness of Variance Reduction Techniques in Manufacturing, Call Center and Cross-Docking Discrete Event Simulation Models

An Investigation of the Sequential Sampling Method for Crossdocking Simulation Output Variance Reduction

Optimisation of a Crossdocking Distribution Centre Simulation Model

Estimating Simulation Metamodels Using Combined Correlation-Based Variance Reduction Techniques

Efficient Simulation Resource Sharing and Allocation for Selecting the Best.

Decision Support for Lead Time and Demand Variability Reduction

Noise Reduction Technique for a Simulation Optimisation Study

A vector space model for variance reduction in single machine scheduling

Moving Beyond the Mean: Analyzing Variance in Software Engineering Experiments

Reducing Simulation Input-Model Risk via Input Model Averaging

Reducing the Variance of Likelihood Ratio Greeks with Monte Carlo

Control Variates as a Variance Reduction Technique for Random Projections

Simulation Optimization of the Crossdock Door Assignment Problem

Improving non-deterministic uncertainty modelling in Industry 4.0 scheduling

Cross Entropy and Adaptive Variance Scaling in Continuous EDA

Variance-reduced sampling importance resampling

Microsimulation Model for Analysis of Traffic Flow in Container Port

A Shrinkage Approach to Improve Direct Bootstrap Resampling Under Input Uncertainty

Variance reduction combining pre-experiment and in-experiment data

Validation of a Microsimulation of the Port of Dover.