Abstract:Metaverse has emerged as a revolutionary technique for transforming the way people interact with digital content, which relies on a distributed computing and communication infrastructure, encompassing terminal users, edge servers, and cloud servers. However, the rapid evolution of the Metaverse presents challenges that surpass the capabilities of existing communication and network infrastructures, particularly on network bandwidth and latency. Additionally, human experience becomes a critical factor in this domain. Therefore, we introduce a human-aware hierarchical software defined network (SDN) architecture consisting of a Metaverse cloud layer, a mobile edge computing (MEC) server empowered edge layer, and a distributed terminal layer. Each MEC server dynamically controls a multi-antenna base station (BS) and several reconfigurable intelligent surfaces (RISs) according to the terminal immersive experience requirements in real-time. To overcome the bandwidth limitation, we propose a novel smart reconfigurable spatial reuse new radio in unlicensed spectrum (NR-U) framework, which can realize customizable communications through flexibly and coordinately reconfiguring beams among the coordination between BSs and RISs. The objective function is formulated as a Lyapunov optimization based decentralized partially-observable Markov decision process (Dec-POMDP) problem to maximize the spectral efficiency while guaranteeing the latency and reliability requirements in Metaverse, via a joint user selection, phase-shift control, and beam coordination strategy. To solve the above non-convex, strongly coupled, and mixed integer nonlinear programming (MINLP), we propose a novel multi-agent hierarchical deep reinforcement learning (MAHDRL) algorithm that integrates deep Q-network (DQN) to solve discrete problems, deep deterministic policy gradient (DDPG) to solve continuous problems, and mixing network to capture complex interactions between multiple agents. Numerical results demonstrate the effectiveness of the proposed algorithm and verify the performance improvements compared to traditional multi-agent deep reinforcement learning (MADRL) algorithms.

QoE Analysis and Resource Allocation for Wireless Metaverse Services

Resource Allocation of Federated Learning Assisted Mobile Augmented Reality System in the Metaverse

Human-Centric Resource Allocation in the Metaverse over Wireless Communications

Attention-aware Resource Allocation and QoE Analysis for Metaverse xURLLC Services

Joining Edge-Enabled Metaverse Services with Network Externality: A Stackelberg Game Approach.

Wireless Metaverse Behavior Models and Optimization Based on Bandwagon Effects

Environment-aware Dynamic Resource Allocation for VR Video Services in Vehicle Metaverse

Location-Dependent Augmented Reality Services in Wireless Edge-Enabled Metaverse Systems

Resource Allocation and Resolution Control in the Metaverse with Mobile Augmented Reality

Mobile Edge Computing and AI Enabled Web3 Metaverse over 6G Wireless Communications: A Deep Reinforcement Learning Approach

Exploring Attention-Aware Network Resource Allocation for Customized Metaverse Services

QoE Fairness Resource Allocation in Digital Twin-Enabled Wireless Virtual Reality Systems

Assessing the Impact of Network Quality-of-Service on Metaverse Virtual Reality User Experience

Unified Resource Allocation Framework for the Edge Intelligence-Enabled Metaverse

Efficient Resource Allocation for NOMA-MEC System in Ultra-dense Network: A Mean Field Game Approach

Bi-Meta: Bi-Alternating Resource Provisioning and Heterogeneous Auction for Mobile Metaverse

The Metaverse from a Multimedia Communications Perspective

QoE Optimization for Virtual Reality Services in Multi-RIS-Assisted Terahertz Wireless Networks

Dual-Level Resource Provisioning and Heterogeneous Auction for Mobile Metaverse

Resource Allocation for Augmented Reality Empowered Vehicular Edge Metaverse

Human-Aware Dynamic Hierarchical Network Control for Distributed Metaverse Services