Abstract:Propelled by recent advances in Mobile Edge Computing (MEC) and the Internet of Things (IoT), the digital twin technique has been envisioned as a de-facto driving force to bridge the virtual and physical worlds through creating digital portrayals of physical objects. In virtue of the flourishing of edge intelligence and abundant IoT data, data-driven modelling facilitates the implementation and maintenance of digital twins, where simulations of physical objects are usually performed based on Deep Neural Networks (DNNs). A significant advantage of adopting digital twins is to enable decisive prediction on the behaviours of objects in near future without waiting for that really happen. To provide accurate predictions, it is vital to keep each digital twin synchronized with its physical object in real-time. However, it is challenging to maintain the real-time synchronization between a digital twin and its physical object due to the dynamics of physical objects and sensing data drift over time, i.e., the live data from a physical object diverge from the model training data of its digital twin. To address this critical issue, continual learning is a promising solution to retrain models of digital twins incrementally. In this paper, we investigate digital twin synchronization issues via continual learning in an MEC environment, with the aim to maximize the total utility gain, i.e., the enhanced model accuracy. We study two novel optimization problems: the static digital twin synchronization problem per time slot and the dynamic digital twin synchronization problem for a finite time horizon. We first formulate an Integer Linear Program (ILP) solution for the static digital twin synchronization problem when the problem size is small; otherwise, we develop a randomized approximation algorithm at the expense of bounded resource violations for it. We also devise a deterministic approximation algorithm with guaranteed performance for a special case of the static digital twin synchronization problem. We thirdly consider the dynamic digital twin synchronization problem by proposing an efficient online algorithm for it. Finally, we evaluate the performance of the proposed algorithms for continuous digital twin synchronization through simulations. Simulation results show that the proposed algorithms are promising, outperforming counterpart benchmarks by no less than 13.2%, in terms of the total utility gain.

Digital Twin-Assisted Edge Service Caching for Consumer Electronics Manufacturing

Reinforcement learning for cost-effective IoT service caching at the edge

Edge Computing Empowered Digital Twin: an End-to-End Computing Task Scheduling Approach

Customer Centric Service Caching for Intelligent Cyber-Physical Transportation Systems with Cloud-Edge Computing Leveraging Digital Twins

Cooperative Task Offloading and Service Caching for Digital Twin Edge Networks: A Graph Attention Multi-Agent Reinforcement Learning Approach

A deep learning-based edge caching optimization method for cost-driven planning process over IIoT

A3C-Based and Dependency-Aware Computation Offloading and Service Caching in Digital Twin Edge Networks

Digital Twin-Assisted Data-Driven Optimization for Reliable Edge Caching in Wireless Networks

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Digital Twin-Enabled Service Satisfaction Enhancement in Edge Computing

DDQN-based Online Computation Offloading and Application Caching for Dynamic Edge Computing Service Management

Digital Twin-assisted Reinforcement Learning for Resource-aware Microservice Offloading in Edge Computing

A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks With Transient Data

Digital Twin-Enabled Service Provisioning in Edge Computing Via Continual Learning

Computation Offloading and Service Caching for Intelligent Transportation Systems With Digital Twin

Caching-based task scheduling for edge computing in intelligent manufacturing

Lyapunov-guided Deep Reinforcement Learning for service caching and task offloading in Mobile Edge Computing

Cache-Aided MEC for IoT: Resource Allocation Using Deep Graph Reinforcement Learning

Dual-Timescale Resource Allocation for Collaborative Service Caching and Computation Offloading in IoT Systems.

Collaborative Edge Computing and Caching with Deep Reinforcement Learning Decision Agents

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning