Abstract:In the coming era of Metaverse, Augmented Reality (AR) has become a key enabler of diverse applications including healthcare, education, smart cities, and entertainments. To provide users with interactive and immersive experience, most AR applications require extremely high responsiveness and ultra-low processing latency. Mobile edge computing (MEC) has demonstrated great potentials in meeting such stringent latency requirements and resource demands of AR applications, by implementing AR requests in edge servers within the proximity of users. In this paper, we investigate the reward maximization problem for AR applications with uncertain resource demands in an MEC network, such that the accumulative reward of services provided for AR applications is maximized, while ensuring that the responsiveness of AR applications is enhanced, subject to network resource capacity. To this end, we formulate an exact solution when the problem size is small, otherwise we devise an efficient approximation algorithm with a provable approximation ratio for the problem. We also develop an online learning algorithm with a bounded regret for the dynamic reward maximization problem without the knowledge of future arrivals of AR requests, by adopting the Multi-Armed Bandits (MAB) technique. Considering maximizing the reward may defer the implementations of some urgent yet low-award requests, we propose a fairness-aware online learning algorithm for the dynamic reward maximization problem, through a data rate prediction mechanism that adopts a multi-task and multi-timescale Long Short-Term Memory (MT $^2$ -LSTM) method. Finally, we evaluate the performance of the proposed algorithms for AR applications by building a real test bed. Experimental results show that the proposed algorithms outperform existing studies by improving the award by 13%.

Gain Without Pain: Enabling Real-time Environmental Perception on 2x Mobile Devices in Multiplayer Augmented Reality.

Tile-based Proactive Virtual Reality Streaming Via Online Hierarchial Learning

Mobile Edge Resource Optimization for Multiplayer Interactive Virtual Reality Game

Wireless Multiplayer Interactive Virtual Reality Game Systems with Edge Computing: Modeling and Optimization

Optimizing the Learning Performance in Mobile Augmented Reality Systems with CNN

Wireless Multi-User Interactive Virtual Reality in Metaverse with Edge-Device Collaborative Computing

Online Learning Algorithms for Offloading Augmented Reality Requests with Uncertain Demands in MECs

Multi-User Cooperative Mobile Video Streaming: Performance Analysis and Online Mechanism Design

Play to Earn in the Metaverse with Mobile Edge Computing over Wireless Networks: A Deep Reinforcement Learning Approach

Reinforcement Learning Based Wireless Augmented Reality on Mobile Edge Computing

Learning-Driven Algorithms for Responsive AR Offloading with Non-Deterministic Rewards in Metaverse-Enabled MEC

Multi-server Multi-user Game at Edges for Heterogeneous Video Analytics

Delay-guaranteed Mobile Augmented Reality Task Offloading in Edge-assisted Environment

Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality Streaming

Intelli-AR Preloading: A Learning Approach to Proactive Hologram Transmissions in Mobile AR

Toward Cooperative Multi-Agent Video Streaming Perception

Edge intelligence computing for mobile augmented reality with deep reinforcement learning approach

Improving Cloud Gaming Experience through Mobile Edge Computing

Energy-Efficient Task Offloading and Resource Allocation via Deep Reinforcement Learning for Augmented Reality in Mobile Edge Networks

Ultra-low latency communication technology for Augmented Reality application in mobile periphery computing

DiTing: Edge Assisted Real-time ID-aware Visual Interaction for Multi-user Augmented Reality