Abstract:The explosive growth of users and applications in IoT environments has promoted the development of cloud computing. In the cloud computing environment, task scheduling plays a crucial role in optimizing resource utilization and improving overall performance. However, effective task scheduling remains a key challenge. Traditional task scheduling algorithms often rely on static heuristics or manual configuration, limiting their adaptability and efficiency. To overcome these limitations, there is increasing interest in applying reinforcement learning techniques for dynamic and intelligent task scheduling in cloud computing. How can reinforcement learning be applied to task scheduling in cloud computing? What are the benefits of using reinforcement learning-based methods compared to traditional scheduling mechanisms? How does reinforcement learning optimize resource allocation and improve overall efficiency? Addressing these questions, in this paper, we propose a Q-learning-based Multi-Task Scheduling Framework (QMTSF). This framework consists of two stages: First, tasks are dynamically allocated to suitable servers in the cloud environment based on the type of servers. Second, an improved Q-learning algorithm called UCB-based Q-Reinforcement Learning (UQRL) is used on each server to assign tasks to a Virtual Machine (VM). The agent makes intelligent decisions based on past experiences and interactions with the environment. In addition, the agent learns from rewards and punishments to formulate the optimal task allocation strategy and schedule tasks on different VMs. The goal is to minimize the total makespan and average processing time of tasks while ensuring task deadlines. We conducted simulation experiments to evaluate the performance of the proposed mechanism compared to traditional scheduling methods such as Particle Swarm Optimization (PSO), random, and Round-Robin (RR). The experimental results demonstrate that the proposed QMTSF scheduling framework outperforms other scheduling mechanisms in terms of the makespan and average task processing time.

Intelligent Resource Scheduling for Co-located Latency-critical Services: A Multi-Model Collaborative Learning Approach

Intelligent Resource Scheduling at Scale: A Machine Learning Perspective

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Joint URLLC Traffic Scheduling and Resource Allocation for Semantic Communication Systems

Mobility-Aware Offloading and Resource Allocation for Distributed Services Collaboration

Llumnix: Dynamic Scheduling for Large Language Model Serving

DRL-Scheduling: an Intelligent QoS-Aware Job Scheduling Framework for Applications in Clouds

StraightLine: An End-to-End Resource-Aware Scheduler for Machine Learning Application Requests

SLAQ: Quality-Driven Scheduling for Distributed Machine Learning

Adaptive Pricing and Online Scheduling for Distributed Machine Learning Jobs

Scheduling of Low-Latency Medical Services in Healthcare Cloud with Deep Reinforcement Learning

Adaptive Request Scheduling and Service Caching for MEC-Assisted IoT Networks: an Online Learning Approach

Real-Time Virtual Machine Scheduling in Industry IoT Network: A Reinforcement Learning Method

Adaptive QoS-aware Microservice Deployment with Excessive Loads Via Intra- and Inter-Datacenter Scheduling

Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing

Efficient LLM Scheduling by Learning to Rank

QoS-awareness of Microservices with Excessive Loads Via Inter-Datacenter Scheduling

A Practical Learning-based Approach for Viewer Scheduling in the Crowdsourced Live Streaming.

An Online Load Balancing Scheduling Algorithm for Cloud Data Centers Considering Real-Time Multi-Dimensional Resource

Collaborative Resource Management and Workloads Scheduling in Cloud-Assisted Mobile Edge Computing across Timescales

Reinforcement Learning for Adaptive Resource Scheduling in Complex System Environments