Abstract:Metaverse applications such as virtual reality (VR) content streaming, require optimal resource allocation strategies for mobile edge computing (MEC) to ensure a high-quality user experience. In contrast to online reinforcement learning (RL) algorithms, which can incur substantial communication overheads and longer delays, the majority of existing works employ offline-trained RL algorithms for resource allocation decisions in MEC systems. However, they neglect the impact of desynchronization between the physical and digital worlds on the effectiveness of the allocation strategy. In this paper, we tackle this desynchronization using a continual RL framework that facilitates the resource allocation dynamically for MEC-enabled VR content streaming. We first design a digital twin-empowered edge computing (DTEC) system and formulate a quality of experience (QoE) maximization problem based on attention-based resolution perception. This problem optimizes the allocation of computing and bandwidth resources while adapting the attention-based resolution of the VR content. The continual RL framework in DTEC enables adaptive online execution in a time-varying environment. The reward function is defined based on the QoE and horizon-fairness QoE (hfQoE) constraints. Furthermore, we propose freshness prioritized experience replay - continual deep deterministic policy gradient (FPER-CDDPG) to enhance the performance of continual learning in the presence of time-varying DT updates. We test FPER-CDDPG using extensive experiments and evaluation. FPER-CDDPG outperforms the benchmarks in terms of average latency, QoE, and successful delivery rate as well as meeting the hfQoE requirements and performance over long-term execution while ensuring system scalability with the increasing number of users.

An Adaptive-Filtering Policy for Distributed Virtual Environments

A Data Filtering Approach Based on Updateable Queue & Interactive Stream

Effects of filtering policies on task performance in a desktop CVE system

A Knowledge-Based Adaptive Message Filtering Technique for Collaborative Virtual Environment

QoE-Aware Dynamic Video Rate Adaptation

Adaptive Rolling Smoothing with Heterogeneous Data for Traffic State Estimation and Prediction.

An Effective Aggregation Method in Distributed Virtual Environments

Implementation of Progressive Texture Transmission in Distributed Virtual Environments

Cross-Domain Policy Adaptation via Value-Guided Data Filtering

Adaptive Distributed Filtering of DDoS Traffic on the Internet

Distributed [math] filtering over wireless sensors based on adaptive event triggering

Feedback Scheduling of Real-Time Control Tasks in Power-Aware Embedded Systems

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Distributed Adaptive Networks: A Graphical Evolutionary Game-Theoretic View

A Distributed Adaptive Algorithm for Non-Smooth Spatial Filtering Problems in Wireless Sensor Networks

An Efficient and Adaptive Content Delivery System Based on Hybrid Network

An Adaptive Filtering Mechanism For Energy Efficient Data Prefetching

A Hierarchical Buffer Management Approach to Rate Adaptation for 360-Degree Video Streaming

Index-based XML Routing Algorithm for Distributed Virtual Environment Systems

Toward Adaptive Volumetric Video Streaming: A Joint Network-Viewport Adaptation Framework

Attention-based QoE-aware Digital Twin Empowered Edge Computing for Immersive Virtual Reality