Abstract:The explosive growth of users and applications in IoT environments has promoted the development of cloud computing. In the cloud computing environment, task scheduling plays a crucial role in optimizing resource utilization and improving overall performance. However, effective task scheduling remains a key challenge. Traditional task scheduling algorithms often rely on static heuristics or manual configuration, limiting their adaptability and efficiency. To overcome these limitations, there is increasing interest in applying reinforcement learning techniques for dynamic and intelligent task scheduling in cloud computing. How can reinforcement learning be applied to task scheduling in cloud computing? What are the benefits of using reinforcement learning-based methods compared to traditional scheduling mechanisms? How does reinforcement learning optimize resource allocation and improve overall efficiency? Addressing these questions, in this paper, we propose a Q-learning-based Multi-Task Scheduling Framework (QMTSF). This framework consists of two stages: First, tasks are dynamically allocated to suitable servers in the cloud environment based on the type of servers. Second, an improved Q-learning algorithm called UCB-based Q-Reinforcement Learning (UQRL) is used on each server to assign tasks to a Virtual Machine (VM). The agent makes intelligent decisions based on past experiences and interactions with the environment. In addition, the agent learns from rewards and punishments to formulate the optimal task allocation strategy and schedule tasks on different VMs. The goal is to minimize the total makespan and average processing time of tasks while ensuring task deadlines. We conducted simulation experiments to evaluate the performance of the proposed mechanism compared to traditional scheduling methods such as Particle Swarm Optimization (PSO), random, and Round-Robin (RR). The experimental results demonstrate that the proposed QMTSF scheduling framework outperforms other scheduling mechanisms in terms of the makespan and average task processing time.

Multidimensional Resource and Load Collaborative Scheduling Algorithm Based on Reinforcement Learning for Cloud Data Centers

SLA-DQTS: SLA Constrained Adaptive Online Task Scheduling Based on DDQN in Cloud Computing

Resource Management in Cloud Based on Deep Reinforcement Learning

A Scheduling Scheme in the Cloud Computing Environment Using Deep Q-learning

Cost-optimized Task Scheduling with Improved Deep Q-Learning in Green Data Centers

Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing

Two-level Task Scheduling with Multi-Objectives in Geo-Distributed and Large-Scale SaaS Cloud

Adaptive DRL-Based Task Scheduling for Energy-Efficient Cloud Computing

Deep Reinforcement Learning-Based Multi-Task Scheduling in Cloud Manufacturing under Different Task Arrival Modes

Two-Timescale Joint Optimization of Task Scheduling and Resource Scaling in Multi-Data Center System Based on Multi-Agent Deep Reinforcement Learning

Temporal Task Scheduling for Delay-Constrained Applications in Geo-Distributed Cloud Data Centers

Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning.

DDDQN‐TS: A Task Scheduling and Load Balancing Method Based on Optimized Deep Reinforcement Learning in Heterogeneous Computing Environment

Weighted Double Deep Q-network Based Reinforcement Learning for Bi-Objective Multi-Workflow Scheduling in the Cloud

A Dynamic And Integrated Loadalancing Scheduling Algorithm For Cloud Dataceis Ters

Cloud Manufacturing Task Scheduling under Machinery Breakdown Based on Deep Reinforcement Learning

Hyper-Heuristic Task Scheduling Algorithm Based on Reinforcement Learning in Cloud Computing

Random Task Scheduling Scheme Based on Reinforcement Learning in Cloud Computing

An Online Load Balancing Scheduling Algorithm for Cloud Data Centers Considering Real-Time Multi-Dimensional Resource

Batch Jobs Load Balancing Scheduling in Cloud Computing Using Distributional Reinforcement Learning

UDL: a cloud task scheduling framework based on multiple deep neural networks