Abstract:It is typical to use a single portion of the available data to calibrate hydrological models, and the remainder for model evaluation. To minimize model-bias, this partitioning must be performed so as to ensure distributional representativeness and mutual consistency. However, failure to account for data sampling variability (DSV) in the underlying Data Generating Process can weaken the model's generalization performance. While "K-fold cross-validation " can mitigate this problem, it is computationally inefficient since the calibration/evaluation operations must be repeated numerous times. This paper develops a general strategy for stochastic evolutionary parameter optimization (SEPO) that explicitly accounts for DSV when calibrating a model using any population-based evolutionary optimization algorithm (EOA), such as Shuffled Complex Evolution (SCE). Inspired in part by the machine-learning strategy of stochastic gradient descent (SGD), we use various representative random sub-samples to drive the EOA toward the distribution of the model parameters. Unlike in SGD, derivative information is not required and hence SEPO can be applied to any hydrological model where such information is not readily available. To demonstrate the effectiveness of the proposed strategy, we implement it within the well-known SCE, to calibrate the GR4J conceptual rainfall-runoff model to 163 hydro-climatically diverse catchments. Using only a single optimization run, our Stochastic SCE method converges to population-based estimates of model parameter distributions (and corresponding simulation uncertainties), without compromising model performance during either calibration or evaluation. Further, it effectively reduces the need to perform independent evaluation tests of model performance under conditions that are represented by the available data.

A sequential sampling strategy to improve the global fidelity of metamodels in multi-level system design

Sequential Sampling Framework for Metamodeling Uncertainty Reduction in Multilevel Optimization of Hierarchical Systems

On Sequential Sampling for Global Metamodeling in Engineering Design

Simulation-Based Robust Design of Complex Product Considering Uncertainties of Metamodel, Design Variables, and Noise Parameters

Metamodel-based design optimization employing a novel sequential sampling strategy

A Sequential Sampling Method for Adaptive Metamodeling Using Data with Highly Nonlinear Relation Between Input and Output Parameters

A Sequential Sampling Approach for Multi-Fidelity Surrogate Modeling-Based Robust Design Optimization

A Robust Strategy to Account for Data Sampling Variability in the Development of Hydrological Models

A New Sequential Sampling Method for Surrogate Modeling Based on a Hybrid Metric

A method of combined metamodel and subset simulation for reliability analysis of rare events

Metamodeling techniques for CPU-intensive simulation-based design optimization: a survey

A new sequential sampling method of surrogate models for design and optimization of dynamic systems

Optimizing Latin hypercube design for sequential sampling of computer experiments

Comparative study of metamodeling and sampling design for expensive and semi-expensive simulation models under uncertainty

Sensitivity Analysis of Expensive Black-Box Systems Using Metamodeling

Efficient metamodel-based importance sampling coupled with single-loop estimation method for parameter global reliability sensitivity analysis

Global-Local Metamodel Assisted Two-Stage Optimization via Simulation

Multi-fidelity Sampling for Efficient Simulation-Based Decision Making in Manufacturing Management

A new adaptive sequential sampling method to construct surrogate models for efficient reliability analysis

A novel multi-fidelity surrogate modeling framework integrated with sequential sampling criterion for non-hierarchical data

A new sequential sampling method for constructing the high-order polynomial surrogate models