Abstract:Hybrid cloud is an emerging computing cloud solution that leverages the power of the public cloud, without abandoning the computation resources of existing on-premises data-centers. Further, the wide adoption of cloud-native technology, like containers, brings the capability of rapid horizontal and vertical scaling to task workloads. However, the heterogeneity and flexibility can bring more complexity to task processing performance optimization, especially with constrained on-premises energy consumption and public cloud renting cost quota. In this paper, we seek to optimize the task processing performance under long-term on-premises energy consumption and public cloud renting cost constraints via dynamic task offloading and elastic scaling. We formulate the problem as a two-stage mixed integer non-linear programming (MINLP) problem, and propose an online approach named ETHC (elastic task offloading and resource allocation handler over hybrid cloud). For the first stage, we introduce a Lyapunov optimization-assisted Deep Reinforcement Learning (DRL) agent to decompose the long-term optimization problem into per-time-segment sub-problems on making task offloading decisions. In the second stage, based on the M/M/k queuing model, we prove the container instance number configuration and per-instance resource allocation problem as a convex MINLP problem. An efficient bi-section-based algorithm is introduced to obtain the optimal configurations. Extensive simulations show that ETHC manages to stabilize the task processing queue and satisfy the long-term constraints under various environments and parameters setup, with slight overhead on the convergence speed. Besides, optimal resource configuration and instance number can be obtained at each time-segment with low time complexity.

Dynamic Job Scheduling On Scalable Cloud Resources

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Scheduling Stochastic Multi-Stage Jobs to Elastic Hybrid Cloud Resources

Elastic and Flexible Multi-Stage Task Scheduling with Deadline-Constraint in Clouds

Scheduling Stochastic Multi-stage Jobs on Elastic Computing Services in Hybrid Clouds.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

Job scheduling optimization based on resource load balance in cloud computing

Long-Term Multi-objective Task Scheduling with Diff-Serv in Hybrid Clouds

A Load-Balance Based Resource-Scheduling Algorithm Under Cloud Computing Environment

Elastic Task Offloading and Resource Allocation over Hybrid Cloud: A Reinforcement Learning Approach

Workload-Aware Scheduling of Real-Time Jobs in Cloud Computing to Minimize Energy Consumption

Cost-aware scheduling for ensuring software performance and reliability under heterogeneous workloads of hybrid cloud

An online cost-efficient scheduler for requests with deadline constraint in hybrid clouds

Hybrid Cloud Adaptive Scheduling Strategy for Heterogeneous Workloads

Energy-Efficient Independent Task Scheduling in Cloud Computing.

A Multi-stage Dynamic Game-Theoretic Approach for Multi-Workflow Scheduling on Heterogeneous Virtual Machines from Multiple Infrastructure-as-a-Service Clouds.

An Energy-Efficient Dynamic Scheduling Method of Deadline-Constrained Workflows in a Cloud Environment

Multi-resource Packing for Job Scheduling in Virtual Machine Based Cloud Environment

General Framework for Task Scheduling and Resource Provisioning in Cloud Computing Systems

Research on Task Allocation and Resource Scheduling Method in Cloud Environment