Abstract:Resource management challenges frequently manifest in systems and networks as tough online decision tasks, for which the proper solution is dependent on an understanding of the workload and environment and facilitates smooth use of mobile edge and cloud resources. Due to the geographical dispersion of resources, constrained resource capacity, unpredictable nature of tasks, and network hierarchy present in such contexts, it is difficult to efficiently schedule jobs in edge environments. Unfortunately, existing heuristic-based methods lack generality and fast adaptability and thus cannot optimally solve such problems. The advantage actor–critic (A2C) method, on the one hand, can quickly adapt to dynamic circumstances based on relatively few data, and deep reinforcement learning (DRL) agents can on the other hand rapidly learn from their experience of environmental interactions to make better judgments. Therefore, we present an A2C-DRL real-time task scheduling technique for stochastic edge–cloud environments that enables decentralized learning and simultaneous work scheduling across multiple servers. With the aim of producing efficient scheduling decisions, we develop reward values for various resources and model the update policy, server resource scheduling method, and policy learning method. The model is adaptive and includes various hyperparameters that can be adjusted in accordance with the application requirements. We evaluate the load balancing capability of the model by introducing a load balancing factor. Experiments on real datasets show that the proposed A2C-DRL method outperforms seven state-of-the-art algorithms in terms of the reward value, task rejection, and the load balancing factor.

Q-greedyUCB: a New Exploration Policy to Learn Resource-Efficient Scheduling

Q-greedyUCB: a New Exploration Policy for Adaptive and Resource-efficient Scheduling

Delay-Aware Stochastic Resource Management for Mobile Edge Computing Systems Via Constrained Reinforcement Learning

Optimal Energy System Scheduling Using A Constraint-Aware Reinforcement Learning Algorithm

Adaptive transmission scheduling over fading channels for energy-efficient cognitive radio networks by reinforcement learning

Optimization of Energy Efficiency for Uplink Murllc over Multiple Cells Using Cooperative Multi-Agent Reinforcement Learning

Multi-User Delay-Constrained Scheduling With Deep Recurrent Reinforcement Learning

Effective Multi-User Delay-Constrained Scheduling with Deep Recurrent Reinforcement Learning

An Approach to Transmitting URLLC Data with Different Latency Requirements over Embb Services Based on Deep Reinforcement Learning

Deep-Reinforcement-Learning-Based Scheduling with Contiguous Resource Allocation for Next-Generation Cellular Systems

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks

Dual Dynamic Scheduling for Hierarchical QoS in Uplink-NOMA: A Reinforcement Learning Approach

Dynamic Channel Selection and Transmission Scheduling for Cognitive Radio Networks.

Delay-Oriented Scheduling in 5G Downlink Wireless Networks Based on Reinforcement Learning With Partial Observations

A Hybrid DQN and Optimization Approach for Strategy and Resource Allocation in MEC Networks

Better than the Best: Gradient-based Improper Reinforcement Learning for Network Scheduling

Dynamic Resource Scheduling Strategy with QoE-aware for the Coexistence of Embb and URLLC Traffic

Low-Coupling Policy Optimization Framework for Power Allocation in Ultra-Dense Small-Cell Networks

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Reinforcement-Learning-Based Scheduling for Age of Information Optimization in MEC Multi-User Network

Real-Time Optimal Scheduling for Active Distribution Networks: A Graph Reinforcement Learning Method