Abstract:Metaverse applications such as virtual reality (VR) content streaming, require optimal resource allocation strategies for mobile edge computing (MEC) to ensure a high-quality user experience. In contrast to online reinforcement learning (RL) algorithms, which can incur substantial communication overheads and longer delays, the majority of existing works employ offline-trained RL algorithms for resource allocation decisions in MEC systems. However, they neglect the impact of desynchronization between the physical and digital worlds on the effectiveness of the allocation strategy. In this paper, we tackle this desynchronization using a continual RL framework that facilitates the resource allocation dynamically for MEC-enabled VR content streaming. We first design a digital twin-empowered edge computing (DTEC) system and formulate a quality of experience (QoE) maximization problem based on attention-based resolution perception. This problem optimizes the allocation of computing and bandwidth resources while adapting the attention-based resolution of the VR content. The continual RL framework in DTEC enables adaptive online execution in a time-varying environment. The reward function is defined based on the QoE and horizon-fairness QoE (hfQoE) constraints. Furthermore, we propose freshness prioritized experience replay - continual deep deterministic policy gradient (FPER-CDDPG) to enhance the performance of continual learning in the presence of time-varying DT updates. We test FPER-CDDPG using extensive experiments and evaluation. FPER-CDDPG outperforms the benchmarks in terms of average latency, QoE, and successful delivery rate as well as meeting the hfQoE requirements and performance over long-term execution while ensuring system scalability with the increasing number of users.

Virtual Reality Streaming in Blockchain Enabled Fog Radio Access Networks

Tile-based Proactive Virtual Reality Streaming Via Online Hierarchial Learning

QoS-driven resource allocation in fog radio access network: A VR service perspective

Distributed Management of Virtual Reality Digital Assets for Online Experimental Education

Blockchain-based fog radio access networks: Architecture, key technologies, and challenges

Deep Reinforcement Learning Based Resource Allocation for Content Distribution in Fog Radio Access Networks

Resource Allocation of Federated Learning Assisted Mobile Augmented Reality System in the Metaverse

Resource allocation for virtual reality content sharing based on 5G D2D multicast communication

Joint optimization of energy consumption and network latency in blockchain-enabled fog computing networks

A Real-time Virtual Reality Adaptive Streaming System

FoVR: Attention-based VR Streaming through Bandwidth-limited Wireless Networks

User Connection and Resource Allocation Optimization in Blockchain Empowered Metaverse over 6G Wireless Communications

Streaming 360-degree VR Video with Statistical QoS Provisioning in mmWave Networks from Delay and Rate Perspectives

Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach

Near Real-Time Data-Driven Control of Virtual Reality Traffic in Open Radio Access Network

Distributed Deep Reinforcement Learning Based Mode Selection and Resource Allocation for VR Transmission in Edge Networks

QoS‐enhanced load balancing strategies for metaverse‐infused VR/AR in engineering education 5.0

Blockchain-Based Resource Allocation Model in Fog Computing

Information-Centric Massive IoT-Based Ubiquitous Connected VR/AR in 6G: A Proposed Caching Consensus Approach

Decentralized Privacy Using Blockchain-Enabled Federated Learning in Fog Computing

Attention-based QoE-aware Digital Twin Empowered Edge Computing for Immersive Virtual Reality