Abstract:Resource management challenges frequently manifest in systems and networks as tough online decision tasks, for which the proper solution is dependent on an understanding of the workload and environment and facilitates smooth use of mobile edge and cloud resources. Due to the geographical dispersion of resources, constrained resource capacity, unpredictable nature of tasks, and network hierarchy present in such contexts, it is difficult to efficiently schedule jobs in edge environments. Unfortunately, existing heuristic-based methods lack generality and fast adaptability and thus cannot optimally solve such problems. The advantage actor–critic (A2C) method, on the one hand, can quickly adapt to dynamic circumstances based on relatively few data, and deep reinforcement learning (DRL) agents can on the other hand rapidly learn from their experience of environmental interactions to make better judgments. Therefore, we present an A2C-DRL real-time task scheduling technique for stochastic edge–cloud environments that enables decentralized learning and simultaneous work scheduling across multiple servers. With the aim of producing efficient scheduling decisions, we develop reward values for various resources and model the update policy, server resource scheduling method, and policy learning method. The model is adaptive and includes various hyperparameters that can be adjusted in accordance with the application requirements. We evaluate the load balancing capability of the model by introducing a load balancing factor. Experiments on real datasets show that the proposed A2C-DRL method outperforms seven state-of-the-art algorithms in terms of the reward value, task rejection, and the load balancing factor.

Deep Reinforcement Learning for Dynamic Twin Automated Stacking Cranes Scheduling Problem

Scheduling of twin automated stacking cranes based on Deep Reinforcement Learning

Container stacking optimization based on Deep Reinforcement Learning

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Stacked Autoencoder-Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks

Scheduling Cooperative Twin Automated Stacking Cranes in Automated Container Terminals

Dynamic Job Shop Scheduling Via Deep Reinforcement Learning

Deep Reinforcement Learning for Dynamic Flexible Job Shop Scheduling with Random Job Arrival

Deep reinforcement learning for dynamic distributed job shop scheduling problem with transfers

Multi-agent Deep Reinforcement Learning for Dynamic Reconfigurable Shop Scheduling Considering Batch Processing and Worker Cooperation

A study on deep reinforcement learning-based crane scheduling model for uncertainty tasks

Multi-AGV Dynamic Scheduling in an Automated Container Terminal: A Deep Reinforcement Learning Approach

Dynamic scheduling of decentralized high-end equipment R&D projects via deep reinforcement learning

DL-DRL: A double-level deep reinforcement learning approach for large-scale task scheduling of multi-UAV

Digital twin-driven deep reinforcement learning for adaptive task allocation in robotic construction

Deep Reinforcement Learning Based Online Lifting Path Planning for Tower Cranes in Unknown Dynamic Environments

Dual Dynamic Attention Network for Flexible Job Scheduling with Reinforcement Learning

Multi-Agent Reinforcement Learning for Real-Time Dynamic Production Scheduling in a Robot Assembly Cell

Deep Reinforcement Learning Assisted Genetic Programming Ensemble Hyper-Heuristics for Dynamic Scheduling of Container Port Trucks

Deep Reinforcement Learning-based Task Assignment and Path Planning for Multi-agent Construction Robots

A Reinforcement Learning Approach for Flexible Job Shop Scheduling Problem With Crane Transportation and Setup Times