Abstract:Numerical simulation models have been one of the most important tools for analyzing real-world problems. Undoubtedly, the increasing requirement of numerical computations raised the computing time problem. Running a parallel model in a multi-processor computer or a cluster of computers can help overcome the single processor limitation and has been widely implemented in recent years. Even so, computing time is still an impediment when an optimization technique is applied to model parameter calibration. Trial-and-error is a traditional way to determine the model parameters. However, such technique requires considerable experience of sophisticated modelers or researchers, and would thus be inapplicable to common engineers or with new models. It is in this context that we propose a general framework for model parameter calibration using job scheduling, which is one of the key capacities of a high-performance computing (HPC) system, e.g., the Windows HPC Server used in this paper. This methodology can be used for various models and optimization techniques. In this study, the model to be calibrated is specified as the Digital Yellow River Integrated Model (DYRIM), a river basin model developed in Tsinghua University. To parallelize model simulation, the DYRIM implements a dynamic spatial domain decomposition method with the Message Passing Interface (MPI) running in HPC system. The genetic algorithm (GA) is used as the optimization technique and developed with the HPC job scheduling interface in the proposed framework. When GA needs to evaluate the fitness of various model parameter combinations, the job scheduler of the HPC system is called to allocate computing resources to a number of jobs simultaneously execute the model with the parameter combinations. After the jobs' execution, the GA collects the model efficiency estimations and proposes a new generation of parameter combinations, until the stop criterion is reached. The specified model and optimization technique are applied to the Qingjian River basin in the Middle Yellow River in northern China. Results demonstrate the framework can effectively make use of computing resources and significantly reducing the computing time, as well as explore the model behavior under different parameter combinations.

Double-layer Parallelization for Hydrological Model Calibration on HPC Systems

A Parallel Simulator for Massive Reservoir Models Utilizing Distributed-Memory Parallel Systems

Research on the single-host parallel computing with the local time step scheme for modeling of hydro-sediment-morphodynamic processes

A General Framework For Model Parameter Calibration Using Job Scheduling Of An Hpc System

A Layered Approach to Parallel Computing for Spatially Distributed Hydrological Modeling

A two-stage surrogate model based on ANN and AdaBoost for multi-objective parameter optimization of the Variable Infiltration Capacity model

Dynamic Parallelization Of Hydrological Model Simulations

A Two-Level Parallelization Method for Distributed Hydrological Models

A common parallel computing framework for modeling hydrological processes of river basins

Parallel Computing for Water Quality Equation Based on Jppf

Review on Parallel Computing of Distributed Hydrological Models

Prediction–Correction Method for Parallelizing Implicit 2D Hydrodynamic Models. II: Application

Computer Aided Numerical Methods for Hydrological Model Calibration: An Overview and Recent Development

A physics-based hydro-geomorphologic simulation utilizing cluster parallel computing

Research on Large Scale Parallel Hydrological Simulation

Parallelization of a grid-to-grid routing algorithm based on grids layering

HydroMP – a Computing Platform for Hydrodynamic Simulation Based on Cloud Computing

Improving Water Quantity Simulation & Forecasting to Solve the Energy-Water-food Nexus Issue by Using Heterogeneous Computing Accelerated Global Optimization Method

Distributed Numerical Hydrological And Hydrodynamic Modelling For Large River Catchment

A hybrid optimization approach for efficient calibration of computationally intensive hydrological models

High-performance Computing in Urban Flood Modeling: A Study on Spatial Partitioning Techniques and Parallel Performance