Abstract:The explosive growth of users and applications in IoT environments has promoted the development of cloud computing. In the cloud computing environment, task scheduling plays a crucial role in optimizing resource utilization and improving overall performance. However, effective task scheduling remains a key challenge. Traditional task scheduling algorithms often rely on static heuristics or manual configuration, limiting their adaptability and efficiency. To overcome these limitations, there is increasing interest in applying reinforcement learning techniques for dynamic and intelligent task scheduling in cloud computing. How can reinforcement learning be applied to task scheduling in cloud computing? What are the benefits of using reinforcement learning-based methods compared to traditional scheduling mechanisms? How does reinforcement learning optimize resource allocation and improve overall efficiency? Addressing these questions, in this paper, we propose a Q-learning-based Multi-Task Scheduling Framework (QMTSF). This framework consists of two stages: First, tasks are dynamically allocated to suitable servers in the cloud environment based on the type of servers. Second, an improved Q-learning algorithm called UCB-based Q-Reinforcement Learning (UQRL) is used on each server to assign tasks to a Virtual Machine (VM). The agent makes intelligent decisions based on past experiences and interactions with the environment. In addition, the agent learns from rewards and punishments to formulate the optimal task allocation strategy and schedule tasks on different VMs. The goal is to minimize the total makespan and average processing time of tasks while ensuring task deadlines. We conducted simulation experiments to evaluate the performance of the proposed mechanism compared to traditional scheduling methods such as Particle Swarm Optimization (PSO), random, and Round-Robin (RR). The experimental results demonstrate that the proposed QMTSF scheduling framework outperforms other scheduling mechanisms in terms of the makespan and average task processing time.

A Scheduling Method of Moldable Parallel Tasks Considering Speedup and System Load on the Cloud

Online Scheduling of Moldable Parallel Tasks.

Resource Management for Moldable Parallel Tasks Supporting Slot Time in the Cloud

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

An Online Parallel Scheduling Method with Application to Energy-Efficiency in Cloud Computing.

An Effective Approximation Algorithm for the Malleable Parallel Task Scheduling Problem

An Energy-Efficient Online Parallel Scheduling Algorithm for Cloud Data Centers

Parallel batch processing machines scheduling in cloud manufacturing for minimizing total service completion time

Multi-Resource Partial-Ordered Task Scheduling in Cloud Computing

Workload-based Multi-Task Scheduling in Cloud Manufacturing

MCTE: Minimizes Task Completion Time and Execution Cost to Optimize Scheduling Performance for Smart Grid Cloud

Approximation Algorithms for Scheduling Monotonic Moldable Tasks on Multiple Platforms

Job Scheduling For Acceleration Systems In Cloud Computing

A Load-Aware Resource Allocation and Task Scheduling for the Emerging Cloudlet System.

Scheduling Real-Time Parallel Applications in Cloud to Minimize Energy Consumption

Heuristic Cloudlet Allocation Approach Based On Optimal Completion Time And Earliest Finish Time

Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing

Method and system for task scheduling based on cloud manufacturing

Cotask Scheduling in Cloud Computing

Parallel random matrix particle swarm optimization scheduling algorithms with budget constraints on cloud computing systems

Scheduling Multi-Skill Technicians and Reassignable Tasks in a Cloud Computing Company