Abstract:Cloud Computing is emerging as a major trend in ICT industry. However, as with any new technology, new major challenges lie ahead, one of them concerning the resource provisioning. Indeed, modern Cloud applications deal with a dynamic context that requires a continuous adaptation process in order to meet satisfactory Quality of Service (QoS) but even the most titled Cloud platform provide just simple rule-based tools; the rudimentary autoscaling mechanisms that can be carried out may be unsuitable in many situations as they do not prevent SLA violations, but only react to them. In addition, these approaches are inherently static and cannot catch the dynamic behavior of the application and are unsuitable to manage multi-Cloud/data center deployments required for mission critical services. This situation calls for advanced solutions designed to provide Cloud resources in a predictive and dynamic way. This work presents capacity allocation algorithms, whose goal is to minimize the total execution cost while satisfying some constraints on the average response time of multi-Cloud based applications. This paper proposes a joint load balancing and receding horizon capacity allocation techniques, which can be employed to handle multiple classes of requests. An extensive evaluation of the proposed solution against an Oracle with perfect knowledge of the future and well-known heuristics proposed in the literature is provided. The analysis shows that our solution outperforms the heuristics producing results very close to the optimal ones, and reducing the number of QoS violations (in the worst case QoS constraints violation rate is 4.26 percent versus up to 17.25 percent of other approaches and can easily reduced by roughly a factor of four by exploiting the receding horizon approach). Furthermore, a sensitivity analysis over two different time scales indicates that finer grained time scales are more appropriate for spiky workloads. Analytical results are validated through simulation, which also analyzes the impact of Cloud environment random perturbations. Finally, experiments on a prototype environment demonstrate the effectiveness of the proposed approach under real workloads.

Unequal‐interval Based Loosely Coupled Control Method for Auto‐scaling Heterogeneous Cloud Resources for Web Applications

Dynamically Adjusting Scale of a Kubernetes Cluster under QoS Guarantee

Online Cost-Aware Service Requests Scheduling in Hybrid Clouds for Cloud Bursting

A Hierarchical Receding Horizon Algorithm for QoS-Driven Control of Multi-IaaS Applications

Adaptive Multivariable Control for Multiple Resource Allocation of Service-Based Systems in Cloud Computing

A Heuristic Approach for Scalability of Multi-tiers Web Application in Clouds

State Space Model and Queuing Network Based Cloud Resource Provisioning for Meshed Web Systems

A Lyapunov-based approach for differentiated service admission control and scheduling in cloud

Design and Implementation of Adaptive Resource Co-Allocation Approaches for Cloud Service Environments

Elastic Resource Allocation in the Cloud

An efficient overload control strategy in cloud

Cost-efficient Coordinated Scheduling for Leasing Cloud Resources on Hybrid Workloads

An Adaptive Management Approach Collaborating Heterogeneous Resources in Cloud Service Environments

A QoS-constrained Scheduling for Access Requests in Cloud Storage

A game theoretical method for auto-scaling of multi-tiers web applications in cloud

Inverse Queuing Model-Based Feedback Control for Elastic Container Provisioning of Web Systems in Kubernetes.

Auto Scaling Virtual Machines for Web Applications with Queueing Theory

Dynamic Controlling of Data Streaming Applications for Cloud Computing

An Adaptive Control Method for Resource Provisioning with Resource Utilization Constraints in Cloud Computing.

HybridScaler: Handling Bursting Workload for Multi-tier Web Applications in Cloud.

Stochastic Workload Scheduling for Uncoordinated Datacenter Clouds with Multiple QoS Constraints