Abstract:The explosive growth of users and applications in IoT environments has promoted the development of cloud computing. In the cloud computing environment, task scheduling plays a crucial role in optimizing resource utilization and improving overall performance. However, effective task scheduling remains a key challenge. Traditional task scheduling algorithms often rely on static heuristics or manual configuration, limiting their adaptability and efficiency. To overcome these limitations, there is increasing interest in applying reinforcement learning techniques for dynamic and intelligent task scheduling in cloud computing. How can reinforcement learning be applied to task scheduling in cloud computing? What are the benefits of using reinforcement learning-based methods compared to traditional scheduling mechanisms? How does reinforcement learning optimize resource allocation and improve overall efficiency? Addressing these questions, in this paper, we propose a Q-learning-based Multi-Task Scheduling Framework (QMTSF). This framework consists of two stages: First, tasks are dynamically allocated to suitable servers in the cloud environment based on the type of servers. Second, an improved Q-learning algorithm called UCB-based Q-Reinforcement Learning (UQRL) is used on each server to assign tasks to a Virtual Machine (VM). The agent makes intelligent decisions based on past experiences and interactions with the environment. In addition, the agent learns from rewards and punishments to formulate the optimal task allocation strategy and schedule tasks on different VMs. The goal is to minimize the total makespan and average processing time of tasks while ensuring task deadlines. We conducted simulation experiments to evaluate the performance of the proposed mechanism compared to traditional scheduling methods such as Particle Swarm Optimization (PSO), random, and Round-Robin (RR). The experimental results demonstrate that the proposed QMTSF scheduling framework outperforms other scheduling mechanisms in terms of the makespan and average task processing time.

Qsmix: Q-learning-based task scheduling approach for mixed-critical applications on heterogeneous multi-cores

Runtime Task Scheduling using Imitation Learning for Heterogeneous Many-Core Systems

Hitsm: A Heuristic Algorithm For Independent Task Scheduling In Multicore

A novel evolutionary-based neuro-fuzzy task scheduling approach to jointly optimize the main design challenges of heterogeneous MPSoCs

Lazy Load Scheduling for Mixed-criticality Applications in Heterogeneous MPSoCs

Task Scheduling for Heterogeneous Computing Based on Learning Classifier System

Power-Aware Run-Time Scheduler for Mixed-Criticality Systems on Multi-Core Platform

Fuzzy logic based feedback scheduler for embedded control systems

METSM: Multiobjective energy-efficient task scheduling model and method for an edge heterogeneous multiprocessor system

Efficient Consolidation-Aware VCPU Scheduling on Multicore Virtualization Platform.

Schedulability Analysis and Stack Size Minimization with Preemption Thresholds and Mixed-Criticality Scheduling.

Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing

Optimizing Task Scheduling in Heterogeneous Computing Environments: A Comparative Analysis of CPU, GPU, and ASIC Platforms Using E2C Simulator

An SMDP-based approach to thermal-aware task scheduling in NoC-based MPSoC platforms

Share Memory Aware Scheduler

Energy efficient EDF-VD-based mixed-criticality scheduling with shared resources

Reinforcement Learning for Adaptive Resource Scheduling in Complex System Environments

Processes Scheduling on Heterogeneous Multi-core Architecture with Hardware Support.

Adaptive Task Allocation and Scheduling on NoC-based Multicore Platforms with Multitasking Processors

Performance evaluation based on task division and scheduling in heterogeneous multi-core systems

Deep Reinforcement Learning-Based Power Management for Chiplet-Based Multicore Systems