Reconsidering the performance of DEVS modeling and simulation environments using the DEVStone benchmark

José L. Risco-Martín,Saurabh Mittal,Juan Carlos Fabero,Marina Zapater,Román Hermida
DOI: https://doi.org/10.1177/0037549717690447
2024-02-08
Abstract:The Discrete Event System Specification formalism (DEVS), which supports hierarchical and modular model composition, has been widely used to understand, analyze and develop a variety of systems. DEVS has been implemented in various languages and platforms over the years. The DEVStone benchmark was conceived to generate a set of models with varied structure and behavior, and to automate the evaluation of the performance of DEVS-based simulators. However, DEVStone is still in a preliminar phase and more model analysis is required. In this paper, we revisit DEVStone introducing new equations to compute the number of events triggered. We also introduce a new benchmark, called HOmem, designed as an alternative version of HOmod, with similar CPU and memory requirements, but with an easier implementation and analytically more manageable. Finally, we compare both the performance and memory footprint of five different DEVS simulators in two different hardware platforms.
Performance
What problem does this paper attempt to address?
The main focus of this paper is the performance of DEVS (Discrete Event System Specification) modeling and simulation environments. DEVS is widely used for understanding and analyzing various systems. The mentioned DEVStone benchmark in the paper is a tool for automating the evaluation of DEVS-based simulator performance, but it is still in the preliminary stage and requires further model analysis. The author revisits DEVStone in the paper, introducing new equations to calculate the number of triggered events and proposes a new benchmark, HOMem, as an alternative version of HOmod, with similar CPU and memory requirements but simpler implementation and easier management in analysis. Finally, the paper compares the performance and memory usage of five different DEVS simulators on two different hardware platforms. The research objective is to improve the performance evaluation of DEVS simulators and provide a standard for future comparisons.