Abstract:With the interdisciplinary advances of mobile communication and edge computing, massive heterogeneous tasks are accessing wireless networks and competing for the edge-end computing and communication resources. Digital twin (DT), which establishes the digital models of physical objects for simulation, analysis and optimization, provides a promising method for network scheduling and management. This paper proposes a DT-driven edge-end collaborative scheduling algorithm for heterogeneous tasks and heterogeneous computing/communication resources. Specifically, multiple end devices (EDs) cooperate with each other to accomplish a complex job, where each ED can offload individual task to multiple edge servers (ESs) for parallel computing. By fully considering deadline requirements of heterogeneous tasks, maximum computing capabilities of ESs and EDs, computing resource estimation deviations of DT, maximum transmit powers of EDs and tolerable peak interference powers to coexisting EDs, we formulate a job completion time minimization problem to jointly optimize the edge-end task division, transmit power control, computing resource type matching and allocation. To solve this non-convex problem, we first reformulate it by multi-agent Markov decision process, where a compound reward leveraging latency reward and deadline reward according to the task criticality is designed. Then, we propose a multi-agent deep reinforcement learning-based scheduling algorithm, where Actor-Critic framework with estimation and target networks is designed for policy and value iterations. Meanwhile, a step-by-step $\epsilon $ -greedy algorithm is proposed to balance exploration and exploitation, avoiding local optimal trap. Through offline centralized training by DT and online distributed execution by EDs, we realize edge-end collaborative computing for heterogeneous tasks. Experimental results demonstrate that, comparing with typical benchmark algorithms, the proposed algorithm converges with the highest reward and achieves the smallest job completion time, where the deadlines of heterogeneous tasks can be well satisfied respectively.

Hybrid Edge-Cloud Collaborator Resource Scheduling Approach Based on Deep Reinforcement Learning and Multiobjective Optimization

Deep Reinforcement Learning-Based Task Scheduling in IoT Edge Computing

EC-TRL: Evolutionary-Weighted Clustering and Transformer-Augmented Reinforcement Learning for Dynamic Resource Scheduling in Edge Cloud Environments

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Digital Twin-Driven Collaborative Scheduling for Heterogeneous Task and Edge-End Resource Via Multi-Agent Deep Reinforcement Learning.

Cloud–edge Collaboration Task Scheduling in Cloud Manufacturing: an Attention-Based Deep Reinforcement Learning Approach

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Hybrid Task Scheduling in Cloud Manufacturing with Sparse-Reward Deep Reinforcement Learning

Solving task scheduling problems in cloud manufacturing via attention mechanism and deep reinforcement learning

Reinforcement Learning for Task Placement in Collaborative Cloud- Edge Computing

Joint Task Assignment and Migration in Cloud-Edge-End Collaborative Computing Based on DRL

Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Cloud-Edge-End Collaborative Task Offloading in Vehicular Edge Networks: A Multi-Layer Deep Reinforcement Learning Approach

A New Multi-Domain Cooperative Resource Scheduling Method Using Proximal Policy Optimization

Intelligent Resource Allocation for Edge-Cloud Collaborative Networks: A Hybrid DDPG-D3QN Approach

Componentized Task Scheduling in Cloud-Edge Cooperative Scenarios Based on GNN-enhanced DRL.

A Task Offloading and Resource Allocation Optimization Method in End-Edge-Cloud Orchestrated Computing

Federated Deep Reinforcement Learning for Dynamic Job Scheduling in Cloud-Edge Collaborative Manufacturing Systems

A Deep Reinforcement Learning Approach to Multi-Component Job Scheduling in Edge Computing

Elastic Task Offloading and Resource Allocation over Hybrid Cloud: A Reinforcement Learning Approach