Abstract:This paper addresses the important need for advanced techniques in continuously allocating workloads on shared infrastructures in data centers, a problem arising due to the growing popularity and scale of cloud computing. It particularly emphasizes the scarcity of research ensuring guaranteed capacity in capacity reservations during large-scale failures. To tackle these issues, the paper presents scalable solutions for resource management. It builds on the prior establishment of capacity reservation in cluster management systems and the two-level resource allocation problem addressed by the Resource Allowance System (RAS). Recognizing the limitations of Mixed Integer Linear Programming (MILP) for server assignment in a dynamic environment, this paper proposes the use of Deep Reinforcement Learning (DRL), which has been successful in achieving long-term optimal results for time-varying systems. A novel two-level design that utilizes a DRL-based algorithm is introduced to solve optimal server-to-reservation assignment, taking into account of fault tolerance, server movement minimization, and network affinity requirements due to the impracticality of directly applying DRL algorithms to large-scale instances with millions of decision variables. The paper explores the interconnection of these levels and the benefits of such an approach for achieving long-term optimal results in the context of large-scale cloud systems. We further show in the experiment section that our two-level DRL approach outperforms the MIP solver and heuristic approaches and exhibits significantly reduced computation time compared to the MIP solver. Specifically, our two-level DRL approach performs 15% better than the MIP solver on minimizing the overall cost. Also, it uses only 26 seconds to execute 30 rounds of decision making, while the MIP solver needs nearly an hour.

DeepPlace: Learning to Place Applications in Multi-Tenant Clusters

Multi-Tenant Machine Learning Platform Based on Kubernetes.

Scheduling Distributed Deep Learning Jobs in Heterogeneous Cluster with Placement Awareness

On a Meta Learning-based Scheduler for Deep Learning Clusters

Learning scheduling algorithms for data processing clusters

An Improved Kubernetes Scheduling Algorithm for Deep Learning Platform

SCHED²: Scheduling Deep Learning Training Via Deep Reinforcement Learning.

DL2: A Deep Learning-driven Scheduler for Deep Learning Clusters

Deep Reinforcement Learning for Multi-Resource Multi-Machine Job Scheduling

Learning Interpretable Scheduling Algorithms for Data Processing Clusters

A Dual-Agent Scheduler for Distributed Deep Learning Jobs on Public Cloud Via Reinforcement Learning

Online Scheduling of Distributed Machine Learning Jobs for Incentivizing Sharing in Multi-Tenant Systems

Deep Reinforcement Learning based Online Scheduling Policy for Deep Neural Network Multi-Tenant Multi-Accelerator Systems

Towards Fair and Firm Real-Time Scheduling in DNN Multi-Tenant Multi-Accelerator Systems via Reinforcement Learning

Two-tiered Online Optimization of Region-wide Datacenter Resource Allocation via Deep Reinforcement Learning

RLScheduler: An Automated HPC Batch Job Scheduler Using Reinforcement Learning

A Deep Reinforcement Learning Approach to Multi-Component Job Scheduling in Edge Computing

Data Centers Job Scheduling with Deep Reinforcement Learning

VELTAIR: towards high-performance multi-tenant deep learning services via adaptive compilation and scheduling

Auto-Scaling Containerized Applications in Geo-Distributed Clouds

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing