Abstract:In rare-event simulation, an importance sampling (IS) estimator is regarded as efficient if its relative error, namely, the ratio between its standard deviation and mean, is sufficiently controlled. It is widely known that when a rare-event set contains multiple “important regions” encoded by the so-called dominating points, the IS needs to account for all of them via mixing to achieve efficiency. We argue that in typical experiments, missing less significant dominating points may not necessarily cause inefficiency, and the traditional analysis recipe could suffer from intrinsic looseness by using relative error or, in turn, estimation variance as an efficiency criterion. We propose a new efficiency notion, which we call probabilistic efficiency, to tighten this gap. In particular, we show that under the standard Gartner-Ellis large deviations regime, an IS that uses only the most significant dominating points is sufficient to attain this efficiency notion. Our finding is especially relevant in high-dimensional settings where the computational effort to locate all dominating points is enormous. This paper was accepted by Baris Ata, stochastic models and simulation. Funding: This work was supported by the National Science Foundation Division of Information and Intelligent Systems [Grants IIS-1849280 and IIS-1849304], Division of Civil, Mechanical and Manufacturing Innovation [Grant CAREER CMMI-1834710], and Division of Computer and Network Systems [Grant CNS-2047454]. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2023.4973 .

A self-similarity principle for the computation of rare event probability

Importance Sampling of Interval Markov Chains

Everything everywhere all at once, a probability-based enhanced sampling approach to rare events

Analysis and Simulation of Extremes and Rare Events in Complex Systems

Global sensitivity analysis of rare event probabilities

Computing return times or return periods with rare event algorithms

Bounding rare event probabilities in computer experiments

An Efficient Surrogate-Based Method for Computing Rare Failure Probability

Importance Splitting for Finite-Time Rare Event Simulation

A rare event approach to high dimensional Approximate Bayesian computation

Rare Event Simulation Method Based on Importance Sampling Technology

An Importance Sampling Method with Applications to Rare Event Probability

Cross-entropy-based importance sampling with failure-informed dimension reduction for rare event simulation

Overconservativeness of Variance-Based Efficiency Criteria and Probabilistic Efficiency in Rare-Event Simulation

Coupling rare event algorithms with data-based learned committor functions using the analogue Markov chain

Multilevel Importance Sampling for Rare Events Associated With the McKean--Vlasov Equation

The Single Big Jump Principle in Physical Modelling

Propagation of Input Tail Uncertainty in Rare-Event Estimation: A Light versus Heavy Tail Dichotomy

Rare-Event Simulation for Neural Network and Random Forest Predictors