Abstract:Autoscaling is a vital mechanism in cloud computing that supports the autonomous adjustment of computing resources under dynamic workloads. A primary goal of autoscaling is to stabilize resource utilization at a desirable level, thus reconciling the need for resource-saving with the satisfaction of Service Level Objectives (SLOs). Existing proactive autoscaling methods anticipate the future workload and scale the resources in advance, whereas the reliability may suffer from prediction deviations arising from the frequent fluctuations and noise of cloud workloads; reactive methods rely on real-time system feedback, while the hysteretic nature of reactive methods could cause violations of the rigorous SLOs. To this end, this paper presents OptScaler, a hybrid autoscaling framework that integrates the power of both proactive and reactive methods for regulating CPU utilization. Specifically, the proactive module of OptScaler consists of a sophisticated workload prediction model and an optimization model, where the former provides reliable inputs to the latter for making optimal scaling decisions. The reactive module provides a self-tuning estimator of CPU utilization to the optimization model. We embed Model Predictive Control (MPC) mechanism and robust optimization techniques into the optimization model to further enhance its reliability. Numerical results have demonstrated the superiority of both the workload prediction model and the hybrid framework of OptScaler in the scenario of online services compared to prevalent reactive, proactive, or hybrid autoscalers. OptScaler has been successfully deployed at Alipay, supporting the autoscaling of applets in the world-leading payment platform.

Implementing a Novel Load-Aware Auto Scale Scheme for Private Cloud Resource Management Platform.

Microservice Auto-Scaling Algorithm Based on Workload Prediction in Cloud-Edge Collaboration Environment

Online Cost-Aware Service Requests Scheduling in Hybrid Clouds for Cloud Bursting

A Comparison of Machine Learning Algorithms for Automatic Cloud Resource Scaling on a Multi-Tenant Platform

HybridScaler: Handling Bursting Workload for Multi-tier Web Applications in Cloud.

Service capacity testing method of private cloud platform

A Cost-Aware Auto-Scaling Approach Based on Workload Predictions in Service Clouds

Agile auto scaling for supporting large scale cloud service platform

A statistical based resource allocation scheme in cloud

Load Prediction-Based Automatic Scaling Cloud Computing

In STechAH: An Autoscaling Scheme for Hadoop in the Private Cloud

Adaptscale: An Adaptive Data Scaling Controller For Improving The Multiple Performance Requirements In Clouds

A Resource Elastic Scaling Method of Cloud Platform Based on Benefit Analysis

Cost-aware automatic scaling and workload-aware replica management for edge-cloud environment

A cost-aware auto-scaling approach using the workload prediction in service clouds

OptScaler: A Hybrid Proactive-Reactive Framework for Robust Autoscaling in the Cloud

Load Balancing Based on Cloud Model

RPPS: A Novel Resource Prediction and Provisioning Scheme in Cloud Data Center

An Experience-Based Scheme for Energy-SLA Balance in Cloud Data Centers.

A Reinforcement Learning Based Auto-Scaling Approach for SaaS Providers in Dynamic Cloud Environment

Simulated-Annealing Load Balancing for Resource Allocation in Cloud Environments