Abstract:The explosive growth of users and applications in IoT environments has promoted the development of cloud computing. In the cloud computing environment, task scheduling plays a crucial role in optimizing resource utilization and improving overall performance. However, effective task scheduling remains a key challenge. Traditional task scheduling algorithms often rely on static heuristics or manual configuration, limiting their adaptability and efficiency. To overcome these limitations, there is increasing interest in applying reinforcement learning techniques for dynamic and intelligent task scheduling in cloud computing. How can reinforcement learning be applied to task scheduling in cloud computing? What are the benefits of using reinforcement learning-based methods compared to traditional scheduling mechanisms? How does reinforcement learning optimize resource allocation and improve overall efficiency? Addressing these questions, in this paper, we propose a Q-learning-based Multi-Task Scheduling Framework (QMTSF). This framework consists of two stages: First, tasks are dynamically allocated to suitable servers in the cloud environment based on the type of servers. Second, an improved Q-learning algorithm called UCB-based Q-Reinforcement Learning (UQRL) is used on each server to assign tasks to a Virtual Machine (VM). The agent makes intelligent decisions based on past experiences and interactions with the environment. In addition, the agent learns from rewards and punishments to formulate the optimal task allocation strategy and schedule tasks on different VMs. The goal is to minimize the total makespan and average processing time of tasks while ensuring task deadlines. We conducted simulation experiments to evaluate the performance of the proposed mechanism compared to traditional scheduling methods such as Particle Swarm Optimization (PSO), random, and Round-Robin (RR). The experimental results demonstrate that the proposed QMTSF scheduling framework outperforms other scheduling mechanisms in terms of the makespan and average task processing time.

A Resource Scheduling Optimization Algorithm of Self-organizing Cloud Robot Platform

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Optimal Algorithm Allocation for Single Robot Cloud Systems

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

A Survey on Task Allocation and Scheduling in Robotic Network Systems

Research on the Optimal Combination and Scheduling Method of Crowdsourcing Members in a Cloud Design Platform

Resource Allocation and Service Provisioning in Multi-Agent Cloud Robotics: A Comprehensive Survey

A Ranking Chaos Algorithm for dual scheduling of cloud service and computing resource in private cloud

Scheduling of decentralized robot services in cloud manufacturing with deep reinforcement learning

A multi-objective trade-off framework for cloud resource scheduling based on the Deep Q-network algorithm

A Deep Reinforcement Learning-Based Model for Optimal Resource Allocation and Task Scheduling in Cloud Computing

A DRL-Driven Intelligent Optimization Strategy for Resource Allocation in Cloud-Edge-End Cooperation Environments

Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing

A Novel Task-Scheduling Algorithm of Cloud Computing Based on Particle Swarm Optimization

An effective resource scheduling model for edge cloud oriented AIoT

Resource Optimization Algorithm for Task Offloading of Service Robots with Position Prediction

Application of Machine Learning Optimization in Cloud Computing Resource Scheduling and Management

Multi-Objective Optimization of a Task-Scheduling Algorithm for a Secure Cloud

Job scheduling optimization based on resource load balance in cloud computing

Cloudroid: A Cloud Framework for Transparent and QoS-aware Robotic Computation Outsourcing