Abstract:With the interdisciplinary advances of mobile communication and edge computing, massive heterogeneous tasks are accessing wireless networks and competing for the edge-end computing and communication resources. Digital twin (DT), which establishes the digital models of physical objects for simulation, analysis and optimization, provides a promising method for network scheduling and management. This paper proposes a DT-driven edge-end collaborative scheduling algorithm for heterogeneous tasks and heterogeneous computing/communication resources. Specifically, multiple end devices (EDs) cooperate with each other to accomplish a complex job, where each ED can offload individual task to multiple edge servers (ESs) for parallel computing. By fully considering deadline requirements of heterogeneous tasks, maximum computing capabilities of ESs and EDs, computing resource estimation deviations of DT, maximum transmit powers of EDs and tolerable peak interference powers to coexisting EDs, we formulate a job completion time minimization problem to jointly optimize the edge-end task division, transmit power control, computing resource type matching and allocation. To solve this non-convex problem, we first reformulate it by multi-agent Markov decision process, where a compound reward leveraging latency reward and deadline reward according to the task criticality is designed. Then, we propose a multi-agent deep reinforcement learning-based scheduling algorithm, where Actor-Critic framework with estimation and target networks is designed for policy and value iterations. Meanwhile, a step-by-step $\epsilon $ -greedy algorithm is proposed to balance exploration and exploitation, avoiding local optimal trap. Through offline centralized training by DT and online distributed execution by EDs, we realize edge-end collaborative computing for heterogeneous tasks. Experimental results demonstrate that, comparing with typical benchmark algorithms, the proposed algorithm converges with the highest reward and achieves the smallest job completion time, where the deadlines of heterogeneous tasks can be well satisfied respectively.

A Cloud-Edge Collaboration Framework for Generating Process Digital Twin

Edge Computing Empowered Digital Twin: an End-to-End Computing Task Scheduling Approach

A Multi-Agent and Cloud-Edge Orchestration Framework of Digital Twin for Distributed Production Control

Dynamic Human Digital Twin Deployment at the Edge for Task Execution: A Two-Timescale Accuracy-Aware Online Optimization

Energy- and Cost-Aware Offloading of Dependent Tasks With Edge-Cloud Collaboration for Human Digital Twin

Building a cloud-based digital twin for remote monitoring and control of a robotic assembly system

Task offloading in cloud-edge collaboration-based cyber physical machine tool

Adaptive Task Scheduling in Digital Twin Empowered Cloud-Native Vehicular Networks

Digital Twin-Driven Collaborative Scheduling for Heterogeneous Task and Edge-End Resource Via Multi-Agent Deep Reinforcement Learning.

Digital Twin-Driven Intelligent Task Offloading for Collaborative Mobile Edge Computing

Digital thread-driven cloud-fog-edge collaborative disturbance mitigation mechanism for adaptive production in digital twin discrete manufacturing workshop

Cloud-Edge-Client Collaborative Learning in Digital Twin Empowered Mobile Networks

A digital thread-driven distributed collaboration mechanism between digital twin manufacturing units

Blockchain-based cloud-edge collaborative data management for human-robot collaboration digital twin system

Innovative soft computing-enabled cloud optimization for next-generation IoT in digital twins

Multi-dimensional and Multi-Scale Modeling and Edge-Cloud Collaborative Configuration Method for Digital Twin Manufacturing Cell

A collaborative cloud-edge computing framework in distributed neural network

Development of an edge computing-based cyber-physical machine tool

Enhancing Construction Management Digital Twins Through Process Mining of Progress Logs

A data-driven smart management and control framework for a digital twin shop floor with multi-variety multi-batch production

A reference framework for the digital twin smart factory based on cloud-fog-edge computing collaboration