Abstract:The explosive growth of users and applications in IoT environments has promoted the development of cloud computing. In the cloud computing environment, task scheduling plays a crucial role in optimizing resource utilization and improving overall performance. However, effective task scheduling remains a key challenge. Traditional task scheduling algorithms often rely on static heuristics or manual configuration, limiting their adaptability and efficiency. To overcome these limitations, there is increasing interest in applying reinforcement learning techniques for dynamic and intelligent task scheduling in cloud computing. How can reinforcement learning be applied to task scheduling in cloud computing? What are the benefits of using reinforcement learning-based methods compared to traditional scheduling mechanisms? How does reinforcement learning optimize resource allocation and improve overall efficiency? Addressing these questions, in this paper, we propose a Q-learning-based Multi-Task Scheduling Framework (QMTSF). This framework consists of two stages: First, tasks are dynamically allocated to suitable servers in the cloud environment based on the type of servers. Second, an improved Q-learning algorithm called UCB-based Q-Reinforcement Learning (UQRL) is used on each server to assign tasks to a Virtual Machine (VM). The agent makes intelligent decisions based on past experiences and interactions with the environment. In addition, the agent learns from rewards and punishments to formulate the optimal task allocation strategy and schedule tasks on different VMs. The goal is to minimize the total makespan and average processing time of tasks while ensuring task deadlines. We conducted simulation experiments to evaluate the performance of the proposed mechanism compared to traditional scheduling methods such as Particle Swarm Optimization (PSO), random, and Round-Robin (RR). The experimental results demonstrate that the proposed QMTSF scheduling framework outperforms other scheduling mechanisms in terms of the makespan and average task processing time.

Stochastic Resource Scheduling Via Bilayer Dynamic Markov Decision Process in Mobile Cloud Networks.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

Delay-Aware Stochastic Resource Management for Mobile Edge Computing Systems Via Constrained Reinforcement Learning

Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

Energy Efficient Joint Resource Scheduling for Delay-Aware Traffic in Cloud-RAN.

Stochastic Resource Allocation and Delay Analysis for Mobile Edge Computing Systems

SRAF: A Service-Aware Resource Allocation Framework for VM Management in Mobile Data Networks

Real-Time Multiple-Workflow Scheduling in Cloud Environments

Adaptive Scheduling of Stochastic Task Sequence for Energy-Efficient Mobile Cloud Computing

Stochastic Load Balancing for Virtual Resource Management in Datacenters

Cost-Efficient Request Scheduling and Resource Provisioning in Multiclouds for Internet of Things

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Discrete-time Markov decision process for performance analysis of virtual machine allocation schemes in C-RAN

Collaborative Resource Management and Workloads Scheduling in Cloud-Assisted Mobile Edge Computing across Timescales

A Bi-Objective Learn-and-Deploy Scheduling Method for Bursty and Stochastic Requests on Heterogeneous Cloud Servers

Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing

Cloud platform resource scheduling strategy design based on stochastic model

Multi-Resource Partial-Ordered Task Scheduling in Cloud Computing

An SMDP-based Resource Management Scheme for Distributed Cloud Systems

Parallel random matrix particle swarm optimization scheduling algorithms with budget constraints on cloud computing systems