Abstract:In the coming era of Metaverse, Augmented Reality (AR) has become a key enabler of diverse applications including healthcare, education, smart cities, and entertainments. To provide users with interactive and immersive experience, most AR applications require extremely high responsiveness and ultra-low processing latency. Mobile edge computing (MEC) has demonstrated great potentials in meeting such stringent latency requirements and resource demands of AR applications, by implementing AR requests in edge servers within the proximity of users. In this paper, we investigate the reward maximization problem for AR applications with uncertain resource demands in an MEC network, such that the accumulative reward of services provided for AR applications is maximized, while ensuring that the responsiveness of AR applications is enhanced, subject to network resource capacity. To this end, we formulate an exact solution when the problem size is small, otherwise we devise an efficient approximation algorithm with a provable approximation ratio for the problem. We also develop an online learning algorithm with a bounded regret for the dynamic reward maximization problem without the knowledge of future arrivals of AR requests, by adopting the Multi-Armed Bandits (MAB) technique. Considering maximizing the reward may defer the implementations of some urgent yet low-award requests, we propose a fairness-aware online learning algorithm for the dynamic reward maximization problem, through a data rate prediction mechanism that adopts a multi-task and multi-timescale Long Short-Term Memory (MT $^2$ -LSTM) method. Finally, we evaluate the performance of the proposed algorithms for AR applications by building a real test bed. Experimental results show that the proposed algorithms outperform existing studies by improving the award by 13%.

Online Learning Algorithms for Offloading Augmented Reality Requests with Uncertain Demands in MECs

Learning-Driven Algorithms for Responsive AR Offloading with Non-Deterministic Rewards in Metaverse-Enabled MEC

Reinforcement Learning Based Wireless Augmented Reality on Mobile Edge Computing

Energy-Efficient Task Offloading and Resource Allocation via Deep Reinforcement Learning for Augmented Reality in Mobile Edge Networks

Optimizing the Learning Performance in Mobile Augmented Reality Systems with CNN

Joint Optimization of Task Offloading and Resource Allocation Via Deep Reinforcement Learning for Augmented Reality in Mobile Edge Network

Learning for Exception: Dynamic Service Caching in 5G-Enabled MECs with Bursty User Demands

Multi-Queue-Based Offloading Strategy for Deep Reinforcement Learning Tasks

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Delay-guaranteed Mobile Augmented Reality Task Offloading in Edge-assisted Environment

Joint Service Placement and Computation Offloading in Mobile Edge Computing: an Auction-based Approach.

Context-Aware Online Offloading Strategy with Mobility Prediction for Mobile Edge Computing.

Look-Ahead Task Offloading for Multi-User Mobile Augmented Reality in Edge-Cloud Computing

Multi-user Computation Offloading for Mobile Edge Computing: A Deep Reinforcement Learning and Game Theory Approach

Adaptive Request Scheduling and Service Caching for MEC-Assisted IoT Networks: an Online Learning Approach

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

DRAM: A DRL-based Resource Allocation Scheme for MAR in MEC.

Online Learning Offloading Framework for Heterogeneous Mobile Edge Computing System

Play to Earn in the Metaverse with Mobile Edge Computing over Wireless Networks: A Deep Reinforcement Learning Approach

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

NOMA-Based Multi-User Mobile Edge Computation Offloading via Cooperative Multi-Agent Deep Reinforcement Learning