Abstract:Discrete-event simulation models generate random variates from input distributions and compute outputs according to the simulation logic. The input distributions are typically fitted to finite real-world data and thus are subject to estimation errors that can propagate to the simulation outputs: an issue commonly known as input uncertainty (IU). This paper investigates quantifying IU using the output confidence intervals (CIs) computed from bootstrap quantile estimators. The standard direct bootstrap method has overcoverage due to convolution of the simulation error and IU; however, the brute-force way of washing away the former is computationally demanding. We present two new bootstrap methods to enhance direct resampling in both statistical and computational efficiencies using shrinkage strategies to down-scale the variabilities encapsulated in the CIs. Our asymptotic analysis shows how both approaches produce tight CIs accounting for IU under limited input data and simulation effort along with the simulation sample-size requirements relative to the input data size. We demonstrate performances of the shrinkage strategies with several numerical experiments and investigate the conditions under which each method performs well. We also show advantages of nonparametric approaches over parametric bootstrap when the distribution family is misspecified and over metamodel approaches when the dimension of the distribution parameters is high. History: Accepted by Bruno Tuffin, Area Editor for Simulation. Funding: This work was supported by the National Science Foundation [CAREER CMMI-1834710, CAREER CMMI-2045400, DMS-1854659, and IIS-1849280]. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2022.0044 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2022.0044 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .

An Investigation of the Sequential Sampling Method for Crossdocking Simulation Output Variance Reduction

Reducing Variance in a Crossdocking Simulation Model Using Common Random Numbers and Antithetic Variates

Investigating the Effectiveness of Variance Reduction Techniques in Manufacturing, Call Center and Cross-Docking Discrete Event Simulation Models

Optimisation of a Crossdocking Distribution Centre Simulation Model

On Monitoring Process Variability under Double Sampling Scheme

Determining Sample Size in Binary Measurement System

Combined Variance Reduction Techniques in Fully Sequential Selection Procedures

Simulation Budget Allocation for Improving Scheduling and Routing of Automated Guided Vehicles in Warehouse Management

Efficient Simulation Resource Sharing and Allocation for Selecting the Best.

Short-term Reliability Evaluation Using Control Variable Based Dagger Sampling Method

Cross-docking centre operation optimization using simulation-based genetic algorithm

A Shrinkage Approach to Improve Direct Bootstrap Resampling Under Input Uncertainty

An Application of Computer Simulation to Quality Control in Manufacturing

Multi-fidelity Sampling for Efficient Simulation-Based Decision Making in Manufacturing Management

Managing Inventory and Supply Performance in Assembly Systems with Random Supply Capacity and Demand

Decision Support for Lead Time and Demand Variability Reduction

Variance reduction for sequential sampling in stochastic programming

Dynamic Sampling Allocation under Finite Simulation Budget for Feasibility Determination

Fully Sequential Indifference‐zone Selection Procedures with Variance‐dependent Sampling

DEA models for identifying sensitive performance measures in container port evaluation

Reducing Inventory Cost for a Medical Device Manufacturer Using Simulation