Abstract:The explosive growth of users and applications in IoT environments has promoted the development of cloud computing. In the cloud computing environment, task scheduling plays a crucial role in optimizing resource utilization and improving overall performance. However, effective task scheduling remains a key challenge. Traditional task scheduling algorithms often rely on static heuristics or manual configuration, limiting their adaptability and efficiency. To overcome these limitations, there is increasing interest in applying reinforcement learning techniques for dynamic and intelligent task scheduling in cloud computing. How can reinforcement learning be applied to task scheduling in cloud computing? What are the benefits of using reinforcement learning-based methods compared to traditional scheduling mechanisms? How does reinforcement learning optimize resource allocation and improve overall efficiency? Addressing these questions, in this paper, we propose a Q-learning-based Multi-Task Scheduling Framework (QMTSF). This framework consists of two stages: First, tasks are dynamically allocated to suitable servers in the cloud environment based on the type of servers. Second, an improved Q-learning algorithm called UCB-based Q-Reinforcement Learning (UQRL) is used on each server to assign tasks to a Virtual Machine (VM). The agent makes intelligent decisions based on past experiences and interactions with the environment. In addition, the agent learns from rewards and punishments to formulate the optimal task allocation strategy and schedule tasks on different VMs. The goal is to minimize the total makespan and average processing time of tasks while ensuring task deadlines. We conducted simulation experiments to evaluate the performance of the proposed mechanism compared to traditional scheduling methods such as Particle Swarm Optimization (PSO), random, and Round-Robin (RR). The experimental results demonstrate that the proposed QMTSF scheduling framework outperforms other scheduling mechanisms in terms of the makespan and average task processing time.

A General Cross-Layer Cloud Scheduling Framework for Multiple IoT Computer Tasks

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

An Adaptive Swarm Intelligence-Based Task Scheduling Framework for Heterogeneous IoT Systems.

Deadline-Aware Task Scheduling in a Tiered IoT Infrastructure

General Framework for Task Scheduling and Resource Provisioning in Cloud Computing Systems

Scheduling Algorithms for Heterogeneous Cloud Environment: Main Resource Load Balancing Algorithm and Time Balancing Algorithm

Two-stage Scheduling of Stream Computing for Industrial Cloud-edge Collaboration

Multi-objective Cross-layer Resource Scheduling for Internet of Things in Edge-Cloud Computing

Task Scheduling Strategy for Industrial Control Network based on Cloud-Edge-End Fusion Framework

An IoT-based task scheduling optimization scheme considering the deadline and cost-aware scientific workflow for cloud computing

Task partitioning and offloading in IoT cloud-edge collaborative computing framework: a survey

Churn-resilient Task Scheduling in a Tiered IoT Infrastructure

Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing

Efficient Delay-Aware Task Scheduling for IoT Devices in Mobile Cloud Computing

A Cost-Driven Intelligence Scheduling Approach for Deadline-Constrained IoT Workflow Applications in Cloud Computing

Data Scheduling and Resource Optimization for Fog Computing Architecture in Industrial IoT.

A Research on Genetic Algorithm-Based Task Scheduling in Cloud-Fog Computing Systems

A Heterogeneous Cloud-Edge Collaborative Computing Architecture with Affinity-Based Workflow Scheduling and Resource Allocation for Internet-of-Things Applications

A Multi-Objective Task Scheduling Strategy for Intelligent Production Line Based on Cloud-Fog Computing

A Multi-objective Task Offloading Algorithm for Heterogeneous Cloud-Edge Collaboration in IoT

A BDI Agent-Based Task Scheduling Framework for Cloud Computing