Achieving Flexible Scheduling of Heterogeneous Workflows in Cloud Through a Genetic Programming Based Approach

Yongbo Yu,Yalian Feng,Hui Ma,Aaron Chen,Chen Wang
DOI: https://doi.org/10.1109/cec.2019.8789896
2019-01-01
Abstract:Cloud computing enables enormous computational resources to be scheduled as parallel workflow applications. Most traditional heuristics can only solve one particular scheduling problem. For example, Heterogeneous Earliest Finish Time (HEFT) and Greedy algorithms allocate resources to given ordered list of tasks using a specific single heuristic, which only caters for a specific scheduling problem, e.g. the fixed number of tasks in a workflow and available resources. Many researchers considered the heterogeneous workflows and cloud resources in scheduling in order to minimize the cost and makespan, but the solutions provided are only for specific workflow pattern. In this paper, we demonstrate a workflow scheduling problem which considers the combination of heterogeneous workflows as well as heterogeneous computing resources. We proposed Flexible Scheduling using Genetic Programming (FSGP) approach to min-imize the total cost and makespan of heterogeneous workflows in the cloud. The performance of our proposed FSGP is regardless of the number of tasks in the workflow, available resources and workflow patterns. We evaluated our proposed approach using a benchmark dataset. Performance evaluation of some well-known algorithms such as HEFT and greedy algorithms exhibit that our FSGP approach perform better than other competing algorithms.
What problem does this paper attempt to address?