Abstract:The explosive growth of users and applications in IoT environments has promoted the development of cloud computing. In the cloud computing environment, task scheduling plays a crucial role in optimizing resource utilization and improving overall performance. However, effective task scheduling remains a key challenge. Traditional task scheduling algorithms often rely on static heuristics or manual configuration, limiting their adaptability and efficiency. To overcome these limitations, there is increasing interest in applying reinforcement learning techniques for dynamic and intelligent task scheduling in cloud computing. How can reinforcement learning be applied to task scheduling in cloud computing? What are the benefits of using reinforcement learning-based methods compared to traditional scheduling mechanisms? How does reinforcement learning optimize resource allocation and improve overall efficiency? Addressing these questions, in this paper, we propose a Q-learning-based Multi-Task Scheduling Framework (QMTSF). This framework consists of two stages: First, tasks are dynamically allocated to suitable servers in the cloud environment based on the type of servers. Second, an improved Q-learning algorithm called UCB-based Q-Reinforcement Learning (UQRL) is used on each server to assign tasks to a Virtual Machine (VM). The agent makes intelligent decisions based on past experiences and interactions with the environment. In addition, the agent learns from rewards and punishments to formulate the optimal task allocation strategy and schedule tasks on different VMs. The goal is to minimize the total makespan and average processing time of tasks while ensuring task deadlines. We conducted simulation experiments to evaluate the performance of the proposed mechanism compared to traditional scheduling methods such as Particle Swarm Optimization (PSO), random, and Round-Robin (RR). The experimental results demonstrate that the proposed QMTSF scheduling framework outperforms other scheduling mechanisms in terms of the makespan and average task processing time.

Reinforcement Learning Based Heterogeneous Resource Provisioning for Cloud Web Applications

Reinforcement Learning for Resource Provisioning in Vehicular Cloud

Research on Cloud Computing Resources Provisioning Based on Reinforcement Learning

A Game-Theoretic Method of Fair Resource Allocation for Cloud Computing Services

Dynamic Fine-Grained Resource Provisioning for Heterogeneous Applications in Virtualized Cloud Data Center

RPPS: A Novel Resource Prediction and Provisioning Scheme in Cloud Data Center

An efficient green computing fair resource allocation in cloud computing using modified deep reinforcement learning algorithm

Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing

A Reinforcement Learning Based Auto-Scaling Approach for SaaS Providers in Dynamic Cloud Environment

Application-Aware Dynamic Fine-Grained Resource Provisioning in a Virtualized Cloud Data Center

A Novel Reactive-Predictive Hybrid Resource Provision Method in Cloud Datacenter.

Elastic Task Offloading and Resource Allocation over Hybrid Cloud: A Reinforcement Learning Approach

Cost-Optimized Resource Provision for Cloud Applications

Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Self-learning and Self-Adaptive Resource Allocation for Cloud-Based Software Services

Adaptive Cloud Bundle Provisioning and Multi-Workflow Scheduling Via Coalition Reinforcement Learning

A Deep Reinforcement Learning-Based Model for Optimal Resource Allocation and Task Scheduling in Cloud Computing

Autonomic Decentralized Elasticity Based on a Reinforcement Learning Controller for Cloud Applications

Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System

Reinforcement Learning for Task Placement in Collaborative Cloud- Edge Computing