A heuristic-based package-aware function scheduling approach for creating a trade-off between cold start time and cost in FaaS computing environments
Hossein Ebrahimpour,Mehrdad Ashtiani,Fatemeh Bakhshi,Ghazaleh Bakhtiariazad
DOI: https://doi.org/10.1007/s11227-023-05128-z
IF: 3.3
2023-03-07
The Journal of Supercomputing
Abstract:With the migration of enterprise applications to microservices and containers, cloud service providers, starting with Amazon in 2014, announced a new computational model called function-as-a-service. In these platforms, developers create a set of fine-grained functions with shorter execution times instead of developing coarse-grained software. In addition, the management of system resources and servers is delegated to cloud service providers. This model has many benefits, such as reducing costs, improving resource utilization, and helping developers focus on the core logic of applications. But, still faces many challenges such as cost/usage balance, optimizing performance, programming models, using current development tools, containers’ cold start problem, saving data in caches, security issues, privacy concerns, and scheduling challenges like execution time prediction. In this paper, we focus on scheduling and cold start problems. Reducing the cold start time can result in better response times and hence a better experience for end-users. Compromise occurs when keeping warm operating environments which can reduce cold start times while increasing resource usage costs. The cold start problem is wildly studied, but in this work, we propose a novel dynamic waiting-time adjustment approach in which the waiting time of a container will change dynamically according to the situation. In this study, four different types of decisions for changing the waiting time are introduced and investigated. We aim to create a trade-off by using these decisions at runtime using a heuristic method. Functions’ invocation frequency, function dependency graph, maximum merging time, correct mergers, cost, and timeline are considered for the decision-making process. The performed evaluations demonstrate that the proposed approach results in a 32% improvement over the fixed-time method (i.e., the method used by Apache OpenWhisk). This comparison is made from the cumulative measurement viewpoint which is a combination of response time, turnaround time, cost, and utilization.
computer science, theory & methods,engineering, electrical & electronic, hardware & architecture