A Load Balancing Algorithm in Multi-Tenancy Environment

Tao Zhao,Hailong Sun,Yu Tang,Xudong Liu
DOI: https://doi.org/10.1145/2541614.2541631
2013-01-01
Abstract:ABSTRACTMulti-tenancy brings new challenges to load balancing, since it incurs resource competition and different QoS requirements of hosted applications. Therefore, servers with multiple deployed applications need a proper request scheduling policy to guarantee their quality of service, e.g., response time. However, when under heavy loads, mean response time of some applications may become too high to be acceptable due to the mutual intervention among tenants. In this work, we propose a new load balancing algorithm, "Server Throughput Restriction(STR)", based on M/G/s/s+r queueing model, in order to guarantee each application's mean response time.
What problem does this paper attempt to address?