An Open-Source Benchmark Suite for Cloud and IoT Microservices
Yu Gan,Yanqi Zhang,Dailun Cheng,Ankitha Shetty,Priyal Rathi,Nayan Katarki,Ariana Bruno,Justin Hu,Brian Ritchken,Brendon Jackson,Kelvin Hu,Meghna Pancholi,Yuan He,Brett Clancy,Chris Colen,Fukang Wen,Catherine Leung,Siyuan Wang,Leon Zaruvinsky,Mateo Espinosa,Rick Lin,Zhongling Liu,Jake Padilla,Christina Delimitrou
DOI: https://doi.org/10.48550/arXiv.1905.11055
2019-05-27
Abstract:Cloud services have recently started undergoing a major shift from monolithic applications, to graphs of hundreds of loosely-coupled microservices. Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and utilization. In this paper we explore the implications microservices have across the cloud system stack. We first present DeathStarBench, a novel, open-source benchmark suite built with microservices that is representative of large end-to-end services, modular and extensible. DeathStarBench includes a social network, a media service, an e-commerce site, a banking system, and IoT applications for coordination control of UAV swarms. We then use DeathStarBench to study the architectural characteristics of microservices, their implications in networking and operating systems, their challenges with respect to cluster management, and their trade-offs in terms of application design and programming frameworks. Finally, we explore the tail at scale effects of microservices in real deployments with hundreds of users, and highlight the increased pressure they put on performance predictability.
Distributed, Parallel, and Cluster Computing