Abstract:Metaverse applications such as virtual reality (VR) content streaming, require optimal resource allocation strategies for mobile edge computing (MEC) to ensure a high-quality user experience. In contrast to online reinforcement learning (RL) algorithms, which can incur substantial communication overheads and longer delays, the majority of existing works employ offline-trained RL algorithms for resource allocation decisions in MEC systems. However, they neglect the impact of desynchronization between the physical and digital worlds on the effectiveness of the allocation strategy. In this paper, we tackle this desynchronization using a continual RL framework that facilitates the resource allocation dynamically for MEC-enabled VR content streaming. We first design a digital twin-empowered edge computing (DTEC) system and formulate a quality of experience (QoE) maximization problem based on attention-based resolution perception. This problem optimizes the allocation of computing and bandwidth resources while adapting the attention-based resolution of the VR content. The continual RL framework in DTEC enables adaptive online execution in a time-varying environment. The reward function is defined based on the QoE and horizon-fairness QoE (hfQoE) constraints. Furthermore, we propose freshness prioritized experience replay - continual deep deterministic policy gradient (FPER-CDDPG) to enhance the performance of continual learning in the presence of time-varying DT updates. We test FPER-CDDPG using extensive experiments and evaluation. FPER-CDDPG outperforms the benchmarks in terms of average latency, QoE, and successful delivery rate as well as meeting the hfQoE requirements and performance over long-term execution while ensuring system scalability with the increasing number of users.

AImers-6G: AI-Driven Region-temporal Resource Provisioning for 6G Immersive Services

Collective reinforcement learning based resource allocation for digital twin service in 6G networks

Zero-touch realization of Pervasive Artificial Intelligence-as-a-service in 6G networks

Diffusion-based Auction Mechanism for Efficient Resource Management in 6G-enabled Vehicular Metaverses

Unified Resource Allocation Framework for the Edge Intelligence-Enabled Metaverse

Resource allocation algorithm for MEC based on Deep Reinforcement Learning

Attention-based QoE-aware Digital Twin Empowered Edge Computing for Immersive Virtual Reality

Mobile Edge Computing and AI Enabled Web3 Metaverse over 6G Wireless Communications: A Deep Reinforcement Learning Approach

6G Network AI Architecture for Everyone-Centric Customized Services

AI-Driven Collaborative Resource Allocation for Task Execution in 6G-Enabled Massive IoT

Diffusion-based Reinforcement Learning for Edge-enabled AI-Generated Content Services

Dual-Level Resource Provisioning and Heterogeneous Auction for Mobile Metaverse

User-centric Service Provision for Edge-assisted Mobile AR: A Digital Twin-based Approach

Generative AI-aided Optimization for AI-Generated Content (AIGC) Services in Edge Networks

Toward Immersive Communications in 6G

Customized Slicing for 6G: Enforcing Artificial Intelligence on Resource Management

QoE-based Deep Reinforcement Learning for Resource Allocation in Real Time XR Video Transmission

Stochastic Resource Allocation for Semantic Communication-aided Virtual Transportation Networks in the Metaverse

User-centric Immersive Communications in 6G: A Data-oriented Approach via Digital Twin