Analytically-Driven Resource Management for Cloud-Native Microservices

Yanqi Zhang,Zhuangzhuang Zhou,Sameh Elnikety,Christina Delimitrou
2024-01-06
Abstract:Resource management for cloud-native microservices has attracted a lot of recent attention. Previous work has shown that machine learning (ML)-driven approaches outperform traditional techniques, such as autoscaling, in terms of both SLA maintenance and resource efficiency. However, ML-driven approaches also face challenges including lengthy data collection processes and limited scalability. We present Ursa, a lightweight resource management system for cloud-native microservices that addresses these challenges. Ursa uses an analytical model that decomposes the end-to-end SLA into per-service SLA, and maps per-service SLA to individual resource allocations per microservice tier. To speed up the exploration process and avoid prolonged SLA violations, Ursa explores each microservice individually, and swiftly stops exploration if latency exceeds its SLA.
Distributed, Parallel, and Cluster Computing,Artificial Intelligence
What problem does this paper attempt to address?