Abstract:Metamodelling is an increasingly more popular approach for alleviating the computational burden associated with computationally intensive optimization/management problems in environmental and water resources systems. Some studies refer to the metamodelling approach as function approximation, surrogate modelling, response surface methodology or model emulation. A metamodel-enabled optimizer approximates the objective (or constraint) function in a way that eliminates the need to always evaluate this function via a computationally expensive simulation model. There is a sizeable body of literature developing and applying a variety of metamodelling strategies to various environmental and water resources related problems including environmental model calibration, water resources systems analysis and management, and water distribution network design and optimization. Overall, this literature generally implies metamodelling yields enhanced solution efficiency and (almost always) effectiveness of computationally intensive optimization problems. This paper initially develops a comparative assessment framework which presents a clear computational budget dependent definition for the success/failure of the metamodelling strategies, and then critically evaluates metamodelling strategies, through numerical experiments, against other common optimization strategies not involving metamodels. Three different metamodel-enabled optimizers involving radial basis functions, kriging, and neural networks are employed. A robust numerical assessment within different computational budget availability scenarios is conducted over four test functions commonly used in optimization as well as two real-world computationally intensive optimization problems in environmental and water resources systems. Numerical results show that metamodelling is not always an efficient and reliable approach to optimizing computationally intensive problems. For simpler response surfaces, metamodelling can be very efficient and effective. However, in some cases, and in particular for complex response surfaces when computational budget is not very limited, metamodelling can be misleading and a hindrance, and better solutions are achieved with optimizers not involving metamodels. Results also demonstrate that neural networks are not appropriate metamodelling tools for limited computational budgets while metamodels employing kriging and radial basis functions show comparable overall performance when the available computational budget is very limited.

Metamodel-based design optimization employing a novel sequential sampling strategy

On Sequential Sampling for Global Metamodeling in Engineering Design

A sequential sampling strategy to improve the global fidelity of metamodels in multi-level system design

A Sequential Sampling Method for Adaptive Metamodeling Using Data with Highly Nonlinear Relation Between Input and Output Parameters

Simulation-Based Robust Design of Complex Product Considering Uncertainties of Metamodel, Design Variables, and Noise Parameters

Robust Optimization of Water Infrastructure Planning under Deep Uncertainty Using Metamodels

A New Sequential Sampling Method for Surrogate Modeling Based on a Hybrid Metric

Developments of an Efficient Global Optimal Design Technique – a Combined Approach of MLS and SA Algorithm

A new sequential sampling method of surrogate models for design and optimization of dynamic systems

Global-Local Metamodel Assisted Two-Stage Optimization via Simulation

Optimizing Latin hypercube design for sequential sampling of computer experiments

Sequential Sampling Framework for Metamodeling Uncertainty Reduction in Multilevel Optimization of Hierarchical Systems

A Simulation Data-Driven Design Approach for Rapid Product Optimization.

A Sequential Sampling Approach for Multi-Fidelity Surrogate Modeling-Based Robust Design Optimization

Comparative study of metamodeling and sampling design for expensive and semi-expensive simulation models under uncertainty

An Adaptive Optimal Strategy Based on the Combination of the Dynamic-Q Optimization Method and Response Surface Methodology

Numerical assessment of metamodelling strategies in computationally intensive optimization

Ensemble of surrogate based global optimization methods using hierarchical design space reduction

Expected-Improvement-Based Methods For Adaptive Sampling In Multi-Objective Optimization Problems

Metamodeling techniques for CPU-intensive simulation-based design optimization: a survey

Surrogate-adjoint refine based global optimization method combining with multi-stage fuzzy clustering space reduction strategy for expensive problems