Abstract:Metaverse has emerged as a revolutionary technique for transforming the way people interact with digital content, which relies on a distributed computing and communication infrastructure, encompassing terminal users, edge servers, and cloud servers. However, the rapid evolution of the Metaverse presents challenges that surpass the capabilities of existing communication and network infrastructures, particularly on network bandwidth and latency. Additionally, human experience becomes a critical factor in this domain. Therefore, we introduce a human-aware hierarchical software defined network (SDN) architecture consisting of a Metaverse cloud layer, a mobile edge computing (MEC) server empowered edge layer, and a distributed terminal layer. Each MEC server dynamically controls a multi-antenna base station (BS) and several reconfigurable intelligent surfaces (RISs) according to the terminal immersive experience requirements in real-time. To overcome the bandwidth limitation, we propose a novel smart reconfigurable spatial reuse new radio in unlicensed spectrum (NR-U) framework, which can realize customizable communications through flexibly and coordinately reconfiguring beams among the coordination between BSs and RISs. The objective function is formulated as a Lyapunov optimization based decentralized partially-observable Markov decision process (Dec-POMDP) problem to maximize the spectral efficiency while guaranteeing the latency and reliability requirements in Metaverse, via a joint user selection, phase-shift control, and beam coordination strategy. To solve the above non-convex, strongly coupled, and mixed integer nonlinear programming (MINLP), we propose a novel multi-agent hierarchical deep reinforcement learning (MAHDRL) algorithm that integrates deep Q-network (DQN) to solve discrete problems, deep deterministic policy gradient (DDPG) to solve continuous problems, and mixing network to capture complex interactions between multiple agents. Numerical results demonstrate the effectiveness of the proposed algorithm and verify the performance improvements compared to traditional multi-agent deep reinforcement learning (MADRL) algorithms.

Decentralized Cooperative Caching for Sustainable Metaverse Via Meta Self-Supervision Learning

Intelligent Edge Caching for Metaverse Applications Based on Grover Search

Resource Allocation of Federated Learning Assisted Mobile Augmented Reality System in the Metaverse

Design and Analysis of MEC- and Proactive Caching-Based 360 Mobile VR Video Streaming

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Efficient Federated Learning for Metaverse Via Dynamic User Selection, Gradient Quantization and Resource Allocation

Federated Multi-View Synthesizing for Metaverse

Cloud-Edge-End Collaborative Caching Based on Graph Learning for Cyber-Physical Virtual Reality

MEC-Enabled Cooperative Rendering in Metaverse: A Coalition Formation Game Approach

Hyperdimensional Computing Empowered Federated Foundation Model over Wireless Networks for Metaverse

Human-Aware Dynamic Hierarchical Network Control for Distributed Metaverse Services

Energy-Efficient Distributed Learning and Sharding Blockchain for Sustainable Metaverse

Wireless Multi-User Interactive Virtual Reality in Metaverse with Edge-Device Collaborative Computing

Mobile Edge Computing and AI Enabled Web3 Metaverse over 6G Wireless Communications: A Deep Reinforcement Learning Approach

Cooperative caching algorithm for mobile edge networks based on multi-agent meta reinforcement learning

Practical Network Modeling Using Weak Supervision Signals for Human-Centric Networking in Metaverse

Trust-Worthy Semantic Communications for the Metaverse Relying on Federated Learning

Virtual Reality in Metaverse over Wireless Networks with User-centered Deep Reinforcement Learning

Trustworthy Semantic Communications for the Metaverse Relying on Federated Learning

Goal-oriented Semantic Communications for Metaverse Construction via Generative AI and Optimal Transport

C3Meta: A Context-Aware Cloud-Edge-End Collaboration Framework Toward Green Metaverse