Abstract:Urban drainage models are important tools used by both practitioners and scientists in the field of stormwater management. These models are often conceptual and usually require calibration using local datasets. The quantification of the uncertainty associated with the models is a must, although it is rarely practiced. The International Working Group on Data and Models, which works under the IWA/IAHR Joint Committee on Urban Drainage, has been working on the development of a framework for defining and assessing uncertainties in the field of urban drainage modelling. A part of that work is the assessment and comparison of different techniques generally used in the uncertainty assessment of the parameters of water models. This paper compares a number of these techniques: the Generalized Likelihood Uncertainty Estimation (GLUE), the Shuffled Complex Evolution Metropolis algorithm (SCEM-UA), an approach based on a multi-objective auto-calibration (a multialgorithm, genetically adaptive multi-objective method, AMALGAM) and a Bayesian approach based on a simplified Markov Chain Monte Carlo method (implemented in the software MICA). To allow a meaningful comparison among the different uncertainty techniques, common criteria have been set for the likelihood formulation, defining the number of simulations, and the measure of uncertainty bounds. Moreover, all the uncertainty techniques were implemented for the same case study, in which the same stormwater quantity and quality model was used alongside the same dataset. The comparison results for a well-posed rainfall/runoff model showed that the four methods provide similar probability distributions of model parameters, and model prediction intervals. For ill-posed water quality model the differences between the results were much wider; and the paper provides the specific advantages and disadvantages of each method. In relation to computational efficiency (i.e. number of iterations required to generate the probability distribution of parameters), it was found that SCEM-UA and AMALGAM produce results quicker than GLUE in terms of required number of simulations. However, GLUE requires the lowest modelling skills and is easy to implement. All non-Bayesian methods have problems with the way they accept behavioural parameter sets, e.g. GLUE, SCEM-UA and AMALGAM have subjective acceptance thresholds, while MICA has usually problem with its hypothesis on normality of residuals. It is concluded that modellers should select the method which is most suitable for the system they are modelling (e.g. complexity of the model's structure including the number of parameters), their skill/knowledge level, the available information, and the purpose of their study.

What do I make of your Latinorum? Sensitivity auditing of mathematical modelling

Application of Uncertainty and Sensitivity Analysis in River Basin Management.

Assessing Sensitivities and Uncertainties in Models: A Critical Evaluation

Unpacking uncertainty in the modelling process for energy policy making

The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support

Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices

Global Sensitivity and Domain-Selective Testing for Functional-Valued Responses: An Application to Climate Economy Models

Sensitivity analysis of agent-based models: a new protocol

Global sensitivity and domain‐selective testing for functional‐valued responses: An application to climate economy models

Position Paper: Sensitivity Analysis of Spatially Distributed Environmental Models- a Pragmatic Framework for the Exploration of Uncertainty Sources

Discussion Paper: Should statistics rescue mathematical modelling?

Uncertainty and Sensitivity Analysis in Reservoir Modeling: a Monte Carlo Simulation Approach

Analysis of sloppiness in model simulations: unveiling parameter uncertainty when mathematical models are fitted to data

Software Uncertainty in Integrated Environmental Modelling: the role of Semantics and Open Science

Comparison of different uncertainty techniques in urban stormwater quantity and quality modelling

Towards quantification of uncertainty in predicting water quality failures in integrated catchment model studies

A critical perspective on uncertainty appraisal and sensitivity analysis in life cycle assessment

Uncertainty and Risk in Water Quality Modelling and Management

A streamlined approach to uncertainty and sensitivity analysis for models with spatial outputs with an example from geodiversity assessment

Sensitivity analysis for biomedical models.

Advanced methodology for uncertainty propagation in computer experiments with large number of inputs