Abstract:In the coming era of Metaverse, Augmented Reality (AR) has become a key enabler of diverse applications including healthcare, education, smart cities, and entertainments. To provide users with interactive and immersive experience, most AR applications require extremely high responsiveness and ultra-low processing latency. Mobile edge computing (MEC) has demonstrated great potentials in meeting such stringent latency requirements and resource demands of AR applications, by implementing AR requests in edge servers within the proximity of users. In this paper, we investigate the reward maximization problem for AR applications with uncertain resource demands in an MEC network, such that the accumulative reward of services provided for AR applications is maximized, while ensuring that the responsiveness of AR applications is enhanced, subject to network resource capacity. To this end, we formulate an exact solution when the problem size is small, otherwise we devise an efficient approximation algorithm with a provable approximation ratio for the problem. We also develop an online learning algorithm with a bounded regret for the dynamic reward maximization problem without the knowledge of future arrivals of AR requests, by adopting the Multi-Armed Bandits (MAB) technique. Considering maximizing the reward may defer the implementations of some urgent yet low-award requests, we propose a fairness-aware online learning algorithm for the dynamic reward maximization problem, through a data rate prediction mechanism that adopts a multi-task and multi-timescale Long Short-Term Memory (MT $^2$ -LSTM) method. Finally, we evaluate the performance of the proposed algorithms for AR applications by building a real test bed. Experimental results show that the proposed algorithms outperform existing studies by improving the award by 13%.

DRAM: A DRL-based Resource Allocation Scheme for MAR in MEC.

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

Priority-Aware Resource Allocation for RIS-assisted Mobile Edge Computing Networks: A Deep Reinforcement Learning Approach

Resource allocation algorithm for MEC based on Deep Reinforcement Learning

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment

Resource Allocation of Federated Learning Assisted Mobile Augmented Reality System in the Metaverse

Learning-Driven Algorithms for Responsive AR Offloading with Non-Deterministic Rewards in Metaverse-Enabled MEC

Joint Optimization of Task Offloading and Resource Allocation Via Deep Reinforcement Learning for Augmented Reality in Mobile Edge Network

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Machine and Deep Learning for Resource Allocation in Multi-Access Edge Computing: A Survey

DMORA: Decentralized Multi-SP Online Resource Allocation Scheme for Mobile Edge Computing

DMADRL: A Distributed Multi-agent Deep Reinforcement Learning Algorithm for Cognitive Offloading in Dynamic MEC Networks

Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach

DRL‐based computing offloading approach for large‐scale heterogeneous tasks in mobile edge computing

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

Attention-based QoE-aware Digital Twin Empowered Edge Computing for Immersive Virtual Reality

Joint Service Caching, Communication and Computing Resource Allocation in Collaborative MEC Systems: A DRL-based Two-timescale Approach

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things

Multi-Queue-Based Offloading Strategy for Deep Reinforcement Learning Tasks