Digital Twin Assisted DAG Task Scheduling Via Evolutionary Selection MARL in Large-Scale Mobile Edge Network.

Jiayu Huang,Fanqin Zhou,Lei Feng,Wenjing Li,Mingyu Zhao,Xueqiang Yan,Yan Xi,Jianjun Wu
DOI: https://doi.org/10.1109/iccworkshops57953.2023.10283633
2023-01-01
Abstract:6G is envisioned to serve many compute-intensive and latency-sensitive applications which are now usually formed by functional components in the directed acyclic graphic (DAG) form. Mobile edge computing (MEC) is proven a promising way to offload computing tasks and reduce execution latency. However, the ever-increasing number and heterogeneity of edge computing nodes, as well as the dynamically changing resource state, hinder any centralized scheduler from getting the accurate and timely resource state in the huge number of edge nodes. In this paper, facing a large-scale MEC scenario, we propose a digital twin (DT) assisted multiagent-based task scheduling scheme to jointly optimize task offloading and resource allocation strategy for DAG tasks. The scheme exploits the evolutionary selection multi-agent reinforcement learning (ES-MARL) framework to expedite the training of a large number of agents, while the DT of the mobile edge network keeps the latest state data and enables the centralized training of these distributed agents. The simulation result shows that the proposed scheme can achieve the goals of reducing latency and energy consumption while improving the scheduling success rate, load balancing index, and training efficiency.
What problem does this paper attempt to address?