A balanced scheduler with data reuse and replication for scientific workflows in cloud computing systems

israel casas,javid taheri,rajiv ranjan,lizhe wang,albert y zomaya
DOI: https://doi.org/10.1016/j.future.2015.12.005
2017-01-01
Abstract:Cloud computing provides substantial opportunities to researchers who demand pay-as-you-go computing systems. Although cloud provider (e.g., Amazon Web Services) and application provider (e.g., biologists, physicists, and online gaming companies) both have specific performance requirements (e.g. application response time), it is the cloud schedulers responsibility to map the application to underlying cloud resources. This article presents a Balanced and file ReuseReplication Scheduling (BaRRS) algorithm for cloud computing environments to optimally schedule scientific application workflows. BaRRS splits scientific workflows into multiple sub-workflows to balance system utilization via parallelization. It also exploits data reuse and replication techniques to optimize the amount of data that needs to be transferred among tasks at run-time. BaRRS analyzes the key application features (e.g., task execution times, dependency patterns and file sizes) of scientific workflows for adapting existing data reuse and replication techniques to cloud systems. Further, BaRRS performs a trade-off analysis to select the optimal solution based on two optimization constraints: execution time and monetary cost of running scientific workflows. BaRRS is compared with a state-of-the-art scheduling approach; experiments prove its superior performance. Experiments include four well known scientific workflows with different dependency patterns and data file sizes. Results were promising and also highlighted most critical factors affecting execution of scientific applications on clouds. Experimentation stage includes computer and data intensive workflows.Incrementing number of resources does not guarantee execution time reduction.System utilization significantly drops as number of virtual machines increases.Optimal number of virtual machines depends on workflow characteristics.
What problem does this paper attempt to address?