Abstract:This paper addresses the important need for advanced techniques in continuously allocating workloads on shared infrastructures in data centers, a problem arising due to the growing popularity and scale of cloud computing. It particularly emphasizes the scarcity of research ensuring guaranteed capacity in capacity reservations during large-scale failures. To tackle these issues, the paper presents scalable solutions for resource management. It builds on the prior establishment of capacity reservation in cluster management systems and the two-level resource allocation problem addressed by the Resource Allowance System (RAS). Recognizing the limitations of Mixed Integer Linear Programming (MILP) for server assignment in a dynamic environment, this paper proposes the use of Deep Reinforcement Learning (DRL), which has been successful in achieving long-term optimal results for time-varying systems. A novel two-level design that utilizes a DRL-based algorithm is introduced to solve optimal server-to-reservation assignment, taking into account of fault tolerance, server movement minimization, and network affinity requirements due to the impracticality of directly applying DRL algorithms to large-scale instances with millions of decision variables. The paper explores the interconnection of these levels and the benefits of such an approach for achieving long-term optimal results in the context of large-scale cloud systems. We further show in the experiment section that our two-level DRL approach outperforms the MIP solver and heuristic approaches and exhibits significantly reduced computation time compared to the MIP solver. Specifically, our two-level DRL approach performs 15% better than the MIP solver on minimizing the overall cost. Also, it uses only 26 seconds to execute 30 rounds of decision making, while the MIP solver needs nearly an hour.

Reinforcement Learning Based Resource Allocation in Business Process Management

Learning policies for resource allocation in business processes

An Adaptive Work Distribution Mechanism Based on Reinforcement Learning

A Task Operation Model for Resource Allocation Optimization in Business Process Management

An Entropy-Based Clustering Ensemble Method to Support Resource Allocation in Business Process Management

Automatic Resource Allocation in Business Processes: A Systematic Literature Survey

Business Process Optimization with Reinforcement Learning

Resource Behavior Measure and Application in Business Process Management

Deep-Reinforcement-Learning-Based Predictive Maintenance Model for Effective Resource Management in Industrial IoT

Reinforcement Learning for Adaptive Resource Scheduling in Complex System Environments

Resource Allocation with Workload-Time Windows for Cloud-Based Software Services: A Deep Reinforcement Learning Approach

Learning-based Two-tiered Online Optimization of Region-wide Datacenter Resource Allocation

Two-tiered Online Optimization of Region-wide Datacenter Resource Allocation via Deep Reinforcement Learning

An Approach to Recommend Resources for Business Processes.

Prescriptive Process Monitoring Under Resource Constraints: A Reinforcement Learning Approach

Modelling Complex Resource Requirements in Business Process Management Systems.

Probabilistic Automata-Based Method for Enhancing Performance of Deep Reinforcement Learning Systems

Elastic Resource Management with Adaptive State Space Partitioning of Markov Decision Processes

Using Reinforcement Learning to Optimize Responses in Care Processes: A Case Study on Aggression Incidents

The Optimization of Resource Allocation Based on Process Mining

Reinforcement learning approach for resource allocation in humanitarian logistics