Abstract:In cloud platforms, a common task is to allocate computational resources, e.g., memory and CPU, requested by applications and users. The allocation of these resources, which is an optimal load-balancing task, is considered an NP-Hard problem, being a challenging research area. There are many works proposed in the literature to address this problem. They use several strategies to deal with this optimization problem such as evolutionary algorithms, exact programming and also heuristics. However, some steps of the allocation process are not considered by these works, which are sometimes treated separately and not in an integrated manner. These steps include the applications and users resource consumption request profile as part of the optimization process and defining adequate metrics to check the optimized allocation. To integrate these steps, this work proposes a framework based on the following strategies, widely used in the literature: Genetic Algorithms (GA), Particle Swarm Optimization (PSO) and Linear Programming, besides our Heuristic approach. Furthermore, we restricted the resource allocation optimization to a real-time scenario, facilitating its use in an industrial process. In addition, Key Performance Indicators (KPIs) are proposed to carry out a comparative study in a public dataset. Our experiments showed that our proposed framework achieved better results than the baseline one, e.g., using a random allocation. In some cases, we observed an increase of almost 60% in performance compared with the baseline. In addition, when trying to balance memory and CPU consumption in the cluster, the linear approach performed the best, while the GA achieved the best result in allocating different user profiles across the cluster.

A Load Balance Scheduling Approach for Generative AI on Cloud-Native Environments with Heterogeneous Resources

AI-oriented Workload Allocation for Cloud-Edge Computing.

Scheduling Generative-AI Job DAGs with Model Serving in Data Centers

Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A Multi-Agent Reinforcement Learning Approach

Resource Allocation in Cloud Computing Using Genetic Algorithm and Neural Network

Energy-aware application scheduling based on genetic algorithm.

Container Scheduling Algorithms for Distributed Cloud Environments

Joint Model Assignment and Resource Allocation for Cost-Effective Mobile Generative Services

Efficient resource allocation in heterogeneous clouds: genetic water evaporation optimization for task scheduling

A Genetic Programming Hyper-Heuristic Approach For Online Resource Allocation In Container-Based Clouds

Hybrid Cloud Adaptive Scheduling Strategy for Heterogeneous Workloads

Dynamic Resource Allocation for Deep Learning Clusters with Separated Compute and Storage

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Online AI-Generated Content Request Scheduling with Deep Reinforcement Learning

A Cloud Computing Resource Scheduling Policy Based on Genetic Algorithm with Multiple Fitness

Achieving Flexible Scheduling of Heterogeneous Workflows in Cloud Through a Genetic Programming Based Approach

A Self-Adaptive Workload Balancing Algorithm on Gpu Clusters

Genetic algorithm with skew mutation for heterogeneous resource-aware task offloading in edge-cloud computing

A Novel Dynamic Task Scheduling Algorithm Based on Improved Genetic Algorithm in Cloud Computing

FastAiAlloc: A real-time multi-resources allocation framework proposal based on predictive model and multiple optimization strategies

Energy and time-aware scheduling in diverse virtualized cloud computing environments using optimized self-attention progressive generative adversarial network