Abstract:libEnsemble is a Python-based toolkit for running dynamic ensembles, developed as part of the DOE Exascale Computing Project. The toolkit utilizes a unique generator--simulator--allocator paradigm, where generators produce input for simulators, simulators evaluate those inputs, and allocators decide whether and when a simulator or generator should be called. The generator steers the ensemble based on simulation results. Generators may, for example, apply methods for numerical optimization, machine learning, or statistical calibration. libEnsemble communicates between a manager and workers. We overview the unique characteristics of libEnsemble as well as current and potential interoperability with other packages in the workflow ecosystem. We highlight libEnsemble's dynamic resource features: libEnsemble can detect system resources, such as available nodes, cores, and GPUs, and assign these in a portable way. These features allow users to specify the number of processors and GPUs required for each simulation; and resources will be automatically assigned on a wide range of systems, including Frontier, Aurora, and Perlmutter. Such ensembles can include multiple simulation types, some using GPUs and others using only CPUs, sharing nodes for maximum efficiency. We also describe the benefits of libEnsemble's generator--simulator coupling, which easily exposes to the user the ability to cancel, and portably kill, running simulations based on models that are updated with intermediate simulation output. We demonstrate libEnsemble's capabilities, scalability, and scientific impact via a Gaussian process surrogate training problem for the longitudinal density profile at the exit of a plasma accelerator stage. The study uses gpCAM for the surrogate model and employs either Wake-T or WarpX simulations, highlighting efficient use of resources that can easily extend to exascale.

SimEngine: A Modular Framework for Statistical Simulations in R

SimInf: An R package for Data-driven Stochastic Disease Spread Simulations

The Development of a Realistic Simulation Framework with OMNeT++

ClusterSchedSim: A Unifying Simulation Framework for Cluster Scheduling Strategies

mmodel: A workflow framework to accelerate the development of experimental simulations

ss3sim: An R package for fisheries stock assessment simulation with Stock Synthesis

The Community Simulator: A Python package for microbial ecology

Using simulation studies to evaluate statistical methods

Simulation Factory: Taming Application Configuration and Workflow on High-End Resources

Simulation Framework for Realistic Large-scale Individual-level Data Generation with an Application in the Health Domain

Simulation based sequential Monte Carlo methods for discretely observed Markov processes

A framework for the calibration of social simulation models

SLiM 2: Flexible, Interactive Forward Genetic Simulations

Extending the statistical software package Engine for Likelihood-Free Inference

Automated Calibration of Parallel and Distributed Computing Simulators: A Case Study

Computationally Efficient Simulation of Queues: The R Package queuecomputer

Bio Simulators: a web UI for biological simulation

Portable, heterogeneous ensemble workflows at scale using libEnsemble

FieldSimR: an R package for simulating plot data in multi-environment field trials

NeuroManager: a workflow analysis based simulation management engine for computational neuroscience

Emulation and History Matching Using the hmer Package