Abstract:Sensitivity analysis (SA) is a commonly used approach for identifying important parameters that dominate model behaviors. We use a newly developed software package, a Problem Solving environment for Uncertainty Analysis and Design Exploration (PSUADE), to evaluate the effectiveness and efficiency of ten widely used SA methods, including seven qualitative and three quantitative ones. All SA methods are tested using a variety of sampling techniques to screen out the most sensitive (i.e., important) parameters from the insensitive ones. The Sacramento Soil Moisture Accounting (SAC-SMA) model, which has thirteen tunable parameters, is used for illustration. The South Branch Potomac River basin near Springfield, West Virginia in the U.S. is chosen as the study area. The key findings from this study are: (1) For qualitative SA methods, Correlation Analysis (CA), Regression Analysis (RA), and Gaussian Process (GP) screening methods are shown to be not effective in this example. Morris One-At-a-Time (MOAT) screening is the most efficient, needing only 280 samples to identify the most important parameters, but it is the least robust method. Multivariate Adaptive Regression Splines (MARS), Delta Test (DT) and Sum-Of-Trees (SOT) screening methods need about 400–600 samples for the same purpose. Monte Carlo (MC), Orthogonal Array (OA) and Orthogonal Array based Latin Hypercube (OALH) are appropriate sampling techniques for them; (2) For quantitative SA methods, at least 2777 samples are needed for Fourier Amplitude Sensitivity Test (FAST) to identity parameter main effect. McKay method needs about 360 samples to evaluate the main effect, more than 1000 samples to assess the two-way interaction effect. OALH and LPτ (LPTAU) sampling techniques are more appropriate for McKay method. For the Sobol' method, the minimum samples needed are 1050 to compute the first-order and total sensitivity indices correctly. These comparisons show that qualitative SA methods are more efficient but less accurate and robust than quantitative ones.

Property-based Sensitivity Analysis: An approach to identify model implementation and integration errors

Sensitivity analysis for biomedical models.

A Comprehensive Evaluation of Various Sensitivity Analysis Methods: A Case Study with a Hydrological Model

Study on Global Sensitivity Analysis Method

Probabilistic Sensitivity Analysis Methods for Design Under Uncertainty

The role of sensitivity analysis in the building performance analysis: A critical review

Meaningful Sensitivities: A New Family of Simulation Sensitivity Measures

A software framework for probabilistic sensitivity analysis for computationally expensive models.

Probabilistic and Nonprobabilistic Sensitivity Analyses of Uncertain Parameters

The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support

Sensitivity analysis of agent-based models: a new protocol

A Global Sensitivity Analysis Method Based on ANOVA with Convex Set Model and Its State-Dependent Parameter Solution

A practical treatment of sensitivity analyses in activity level evaluations

Bayesian Sensitivity Analysis of Statistical Models with Missing Data

Sensitivity Analysis in Optimal Software Release Time Problems

Data Type Agnostic Visual Sensitivity Analysis

Sensitivity analysis methods in the biomedical sciences

Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices

[Comment on Sensitivity Analysis Methods for Environmental Models].

Assessment of Parametric Sensitivity Analysis Methods Based on A Quasi Two-Dimensional Groundwater Model

Position Paper: Bridging the Gap Between Machine Learning and Sensitivity Analysis