Abstract:In-memory (transactional) data stores, also referred to as data grids, are recognized as a first-class data management technology for cloud platforms, thanks to their ability to match the elasticity requirements imposed by the pay-as-you-go cost model. On the other hand, determining how performance and reliability/availability of these systems vary as a function of configuration parameters, such as the amount of cache servers to be deployed, and the degree of in-memory replication of slices of data, is far from being a trivial task. Yet, it is an essential aspect of the provisioning process of cloud platforms, given that it has an impact on the amount of cloud resources that are planned for usage. To cope with the issue of predicting/analysing the behavior of different configurations of cloud in-memory data stores, in this article we present a flexible simulation framework offering skeleton simulation models that can be easily specialized in order to capture the dynamics of diverse data grid systems, such as those related to the specific (distributed) protocol used to provide data consistency and/or transactional guarantees. Besides its flexibility, another peculiar aspect of the framework lies in that it integrates simulation and machine-learning (black-box) techniques, the latter being used to capture the dynamics of the data-exchange layer (e.g. the message passing layer) across the cache servers. This is a relevant aspect when considering that the actual data-transport/networking infrastructure on top of which the data grid is deployed might be unknown, hence being not feasible to be modeled via white-box (namely purely simulative) approaches. We also provide an extended experimental study aimed at validating instances of simulation models supported by our framework against execution dynamics of real data grid systems deployed on top of either private or public cloud infrastructures. Particularly, our validation test-bed has been based on an industrial-grade open-source data grid, namely Infinispan by JBoss/Red-Hat, and a de-facto standard benchmark for NoSQL platforms, namely YCSB by Yahoo. The validation study has been conducted by relying on both public and private cloud systems, scaling the underlying infrastructure up to 100 (resp. 140) Virtual Machines for the public (resp. private) cloud case. Further, we provide some experimental data related to a scenario where our framework is used for on-line capacity planning and reconfiguration of the data grid system.

An Elastic Middleware Platform for Concurrent and Distributed Cloud and MapReduce Simulations

CloudSim: A Novel Framework for Modeling and Simulation of Cloud Computing Infrastructures and Services

DartCSim+: Enhanced CloudSim with the Power and Network Models Integrated

DartCSim: An enhanced user-friendly cloud simulation system based on CloudSim with better performance

A Unified Cloud-Enabled Discrete Event Parallel and Distributed Simulation Architecture

Modeling and Simulation of Scalable Cloud Computing Environments and the CloudSim Toolkit: Challenges and Opportunities

CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms

Hsim: A Mapreduce Simulator In Enabling Cloud Computing

Usage of Cloud Computing Simulators and Future Systems For Computational Research

CloudSim Express: A Novel Framework for Rapid Low Code Simulation of Cloud Computing Environments

High performance computing network for cloud environment using simulators

Nutshell: Cloud Simulation and Current Trends

Cloud-Based Simulation: The State-Of-The-Art Computer Simulation Paradigm

Multi-resource scheduling and power simulation for cloud computing

ElasticBroker: Combining HPC with Cloud to Provide Realtime Insights into Simulations

A flexible framework for accurate simulation of cloud in-memory data stores

CloudSim 7G: An Integrated Toolkit for Modeling and Simulation of Future Generation Cloud Computing Environments

Mtcloudsim: A Flow-Level Network Simulator for Multi-Tenant Cloud

EMUSIM: an integrated emulation and simulation environment for modeling, evaluation, and validation of performance of Cloud computing applications

Cloud Services Enable Efficient AI-Guided Simulation Workflows across Heterogeneous Resources

Molecular Dynamics Simulations on Cloud Computing and Machine Learning Platforms