Abstract:As the quantity and complexity of information processed by software systems increase, large-scale software systems have an increasing requirement for high-performance distributed computing systems. With the acceleration of the Internet in Web 2.0, Cloud computing as a paradigm to provide dynamic, uncertain and elastic services has shown superiorities to meet the computing needs dynamically. Without an appropriate scheduling approach, extensive Cloud computing may cause high energy consumptions and high cost, in addition that high energy consumption will cause massive carbon dioxide emissions. Moreover, inappropriate scheduling will reduce the service life of physical devices as well as increase response time to users' request. Hence, efficient scheduling of resource or optimal allocation of request, that usually a NP-hard problem, is one of the prominent issues in emerging trends of Cloud computing. Focusing on improving quality of service (QoS), reducing cost and abating contamination, researchers have conducted extensive work on resource scheduling problems of Cloud computing over years. Nevertheless, growing complexity of Cloud computing, that the super-massive distributed system, is limiting the application of scheduling approaches. Machine learning, a utility method to tackle problems in complex scenes, is used to resolve the resource scheduling of Cloud computing as an innovative idea in recent years. Deep reinforcement learning (DRL), a combination of deep learning (DL) and reinforcement learning (RL), is one branch of the machine learning and has a considerable prospect in resource scheduling of Cloud computing. This paper surveys the methods of resource scheduling with focus on DRL-based scheduling approaches in Cloud computing, also reviews the application of DRL as well as discusses challenges and future directions of DRL in scheduling of Cloud computing.

Scheduling of Low-Latency Medical Services in Healthcare Cloud with Deep Reinforcement Learning

Low-latency Patient Monitoring Service for Cloud Computing Based Healthcare System by Applying Reinforcement Learning

Resource Management in Cloud Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Deep Reinforcement Learning-based Methods for Resource Scheduling in Cloud Computing: A Review and Future Directions

DRL-Scheduling: an Intelligent QoS-Aware Job Scheduling Framework for Applications in Clouds

Job Scheduling in Hybrid Clouds With Privacy Constraints: A Deep Reinforcement Learning Approach

DeepLRA: An Efficient Long Running Application Scheduling Framework with Deep Reinforcement Learning in the Cloud.

Two-tiered Online Optimization of Region-wide Datacenter Resource Allocation via Deep Reinforcement Learning

Optimal scheduling in cloud healthcare system using Q-learning algorithm

A novel deep reinforcement learning scheme for task scheduling in cloud computing

Energy-aware systems for real-time job scheduling in cloud data centers: A deep reinforcement learning approach

An Advanced Reinforcement Learning Framework for Online Scheduling of Deferrable Workloads in Cloud Computing

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Digital twin‐enabled deep reinforcement learning for joint scheduling of ultra‐reliable low latency communication and enhanced mobile broad band: A reliability‐guaranteed approach

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

An Approach to Transmitting URLLC Data with Different Latency Requirements over Embb Services Based on Deep Reinforcement Learning

Random Task Scheduling Scheme Based on Reinforcement Learning in Cloud Computing

Service Function Chain Scheduling Under the Multi-Cloud Collaborative Service of Information Networks Used for Cross-Domain Remote Surgery

Task Scheduling with Optimized Transmission Time in Collaborative Cloud-Edge Learning