Abstract:Metamodelling is an increasingly more popular approach for alleviating the computational burden associated with computationally intensive optimization/management problems in environmental and water resources systems. Some studies refer to the metamodelling approach as function approximation, surrogate modelling, response surface methodology or model emulation. A metamodel-enabled optimizer approximates the objective (or constraint) function in a way that eliminates the need to always evaluate this function via a computationally expensive simulation model. There is a sizeable body of literature developing and applying a variety of metamodelling strategies to various environmental and water resources related problems including environmental model calibration, water resources systems analysis and management, and water distribution network design and optimization. Overall, this literature generally implies metamodelling yields enhanced solution efficiency and (almost always) effectiveness of computationally intensive optimization problems. This paper initially develops a comparative assessment framework which presents a clear computational budget dependent definition for the success/failure of the metamodelling strategies, and then critically evaluates metamodelling strategies, through numerical experiments, against other common optimization strategies not involving metamodels. Three different metamodel-enabled optimizers involving radial basis functions, kriging, and neural networks are employed. A robust numerical assessment within different computational budget availability scenarios is conducted over four test functions commonly used in optimization as well as two real-world computationally intensive optimization problems in environmental and water resources systems. Numerical results show that metamodelling is not always an efficient and reliable approach to optimizing computationally intensive problems. For simpler response surfaces, metamodelling can be very efficient and effective. However, in some cases, and in particular for complex response surfaces when computational budget is not very limited, metamodelling can be misleading and a hindrance, and better solutions are achieved with optimizers not involving metamodels. Results also demonstrate that neural networks are not appropriate metamodelling tools for limited computational budgets while metamodels employing kriging and radial basis functions show comparable overall performance when the available computational budget is very limited.

Metamodel-based simulation optimization: A systematic literature review

Metamodeling-based simulation optimization in manufacturing problems: a comparative study

Discrete simulation-based optimization methods for industrial engineering problems: A systematic literature review

Efficient Multi-Objective Simulation Metamodeling for Researchers

Simulation optimization: A comprehensive review on theory and applications

Simulation Optimization: A Review on Theory and Applications

Numerical assessment of metamodelling strategies in computationally intensive optimization

Metamodeling techniques for CPU-intensive simulation-based design optimization: a survey

A Review of Multi-objective Optimization: Methods and Algorithms in Mechanical Engineering Problems

Knowledge-based modeling of simulation behavior for Bayesian optimization

Modern Optimization and Simulation Methods in Managerial and Business Economics: A Review

A multi-objective optimization strategy based on combined meta-models: Application to a wind turbine

Software Process Simulation Modeling: An Extended Systematic Review

Multi-Fidelity Simulation Modeling for Discrete Event Simulation: An Optimization Perspective

A systematic literature review into simulation for building operations management theory: reaching beyond positivism?

Simulation-based optimization methods applied in hospital emergency departments: A systematic review

Reflections On 10 Years Of Software Process Simulation Modeling: A Systematic Review

Comparative study of metamodeling and sampling design for expensive and semi-expensive simulation models under uncertainty

Global-Local Metamodel Assisted Two-Stage Optimization via Simulation

A Review of Sequential Decision Making via Simulation

Hybrid approaches to optimization and machine learning methods: a systematic literature review