AMAS: Adaptive auto-scaling for edge computing applications

Saptarshi Mukherjee,Subhajit Sidhanta
DOI: https://doi.org/10.1007/s11042-024-19612-y
IF: 2.577
2024-06-19
Multimedia Tools and Applications
Abstract:Edge computing offers a promising approach to building on-demand computing infrastructure, leveraging clusters of small, commodity-scale, cost-effective devices called edge clusters for performing analytics workloads closer to the data sources than the cloud. However, their effectiveness relies heavily on efficient auto-scaling mechanisms. This refers to the ability to automatically scale out (or in) by adding (or removing) devices in a workload-aware manner, so that they may handle highly dynamic and increasingly compute-intensive workloads, which is typical of most IoT applications, with limited budget for acquiring and maintaining the infrastructure, i.e., the devices comprised in the edge cluster. Despite the emergence of edge computing as a key technology, there is a general lack of suitable auto-scaling techniques specifically designed to adapt a given edge cluster to changing application workloads. The existing auto-scaling solutions tailor-made for the cloud cannot be readily applied to an application running on an edge cluster. In this paper, we present AMAS - a novel auto-scaling algorithm, designed specifically for edge clusters, which allows edge devices to be automatically and dynamically added or removed from an edge cluster according to variations in the workload. AMAS offers novel auto-adaptive techniques to enable users to run compute-intensive time-varying workloads comfortably on edge clusters comprised of small, commodity-scale devices. We demonstrate that AMAS outperforms the state-of-the-art auto-scalers particularly in critical failure-prone conditions, reducing the average CPU utilization by at least around 10%, and decreasing the number of delayed requests by around 63%, with respect to the state-of-the-art auto-scalers, with at most 10% larger cluster size. Thus, compared to the state-of-the-art, AMAS provides better real-time performance by reducing delayed requests, while increasing the longevity of the edge devices and decreasing the chances of failure by maintaining lower CPU utilization.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
What problem does this paper attempt to address?