Microservice Workflow Modeling for Affinity Scheduling to Improve the QoS

Yingying Wen,Guanjie Cheng,ShuiGuang Deng,Jianwei Yin
DOI: https://doi.org/10.1007/978-3-031-25158-0_24
2023-01-01
Abstract:Attracted by the flexibility of microservice architecture, many Cloud services are composed of components that communicate with the Remote Procedure Calls (RPC). Considering the high cost of RPC between components running on different machines, this raises a question about how to effectively arrange and place these components to physical machines in Cloud to offer good quality of services. Current co-location strategies mainly consider the resource constraints and performance interference among individual components but ignore the workflow dependencies of components. Though workflow of background jobs has been used as an important modeling element when seeking optimal scheduling schema, the workflow-aware scheduling for microservice applications lacks research efforts. In this paper, we propose a workflow-aware component placement schema for microservice applications to reduce their running time. Specifically, we design a new workflow model based on Directed Acyclic Graph (DAG) and probabilistic theory describing components’ calling and time dependency to predict the running time of applications. Based on the proposed model, we quantify the affinity degree of two components that further supports the pod affinity scheduling. The affinity degree considers multiple dimensions, including the critical path, the possible improvement of running time, and the throughput of user requests. The experimental evaluation results prove the accuracy of the workflow model and its application effect on pod affinity scheduling.
What problem does this paper attempt to address?