Abstract:In order to deal with the fast changing requirements of container based services in clouds, auto-scaling is used as an essential mechanism for adapting the number of provisioned resources with the variable service workloads. However, the latest auto-scaling approaches lack the comprehensive consideration of variable workloads and hybrid auto-scaling for multi-type services. Firstly, the historical data based proactive approaches are widely used to handle complex and variable workloads in advance. The decision-making accuracy of proactive approaches depends on the prediction algorithm, which is affected by the anomalies, missing values and errors in the historical workload data, and the unexpected workload cannot be handled. Secondly, the trigger based reactive approaches are seriously affected by workload fluctuation which causes the frequent invalid scaling of service resources. Besides, due to the existence of scaling time, there are different completion delays of different scaling actions. Thirdly, the latest approaches also ignore the different scaling time of hybrid scaling for multi-type services including stateful services and stateless services. Especially, when the stateful services are scaled horizontally, the neglected long scaling time causes the untimely supply and withdrawal of resources. Consequently, all three issues above can lead to the degradation of Quality of Services (QoS) and the inefficient utilization of resources. This paper proposes a new hybrid auto-scaling approach for multi-type services to resolve the impact of service scaling time on decision making. We combine the proactive scaling strategy with the reactive anomaly detection and correction mechanism. For making a proactive decision, the ensemble learning model with the structure improved deep network is designed to predict the future workload. On the basis of the predicted results and the scaling time of different types of services, the auto-scaling decisions are made by a Deep Reinforcement Learning (DRL) model with heterogeneous action space, which integrates horizontal and vertical scaling actions. Meanwhile, with the anomaly detection and correction mechanism, the workload fluctuation and unexpected workload can be detected and handled. We evaluate our approach against three different proactive and reactive auto-scaling approaches in the cloud environment, and the experimental results show the proposed approach can achieve the better scaling behavior compared to state-of-the-art approaches.

Microscaler: Automatic Scaling for Microservices with an Online Learning Approach

Microservice Auto-Scaling Algorithm Based on Workload Prediction in Cloud-Edge Collaboration Environment

TP-MDU: A Two-Phase Microservice Deployment Based on Minimal Deployment Unit in Edge Computing Environment

An Auto-Scaling Approach for Microservices in Cloud Computing Environments

DeepScaler: Holistic Autoscaling for Microservices Based on Spatiotemporal GNN with Adaptive Graph Learning

ProScale: Proactive Autoscaling for Microservice with Time-Varying Workload at the Edge.

Cdascaler: a cost-effective dynamic autoscaling approach for containerized microservices

PBScaler: A Bottleneck-aware Autoscaling Framework for Microservice-based Applications

StatuScale: Status-aware and Elastic Scaling Strategy for Microservice Applications

MultiScaler: A Multi-Loop Auto-Scaling Approach for Cloud-Based Applications

MSARS: A Meta-Learning and Reinforcement Learning Framework for SLO Resource Allocation and Adaptive Scaling for Microservices

Self-adaptive, Requirements-driven Autoscaling of Microservices

OptScaler: A Hybrid Proactive-Reactive Framework for Robust Autoscaling in the Cloud

Intelligent microservices autoscaling module using reinforcement learning

Automatic Scaling of Internet Applications for Cloud Computing Services

Learning-driven hybrid scaling for multi-type services in cloud

Humas: A Heterogeneity- and Upgrade-aware Microservice Auto-scaling Framework in Large-scale Data Centers

Exploring Micro-Services for Enhancing Internet QoS

Graph Neural Network-Based SLO-Aware Proactive Resource Autoscaling Framework for Microservices

LSRAM: A Lightweight Autoscaling and SLO Resource Allocation Framework for Microservices Based on Gradient Descent

HCA Operator: A Hybrid Cloud Auto-scaling Tooling for Microservice Workloads.