Abstract:Unmanned aerial vehicle (UAV) swarms have found extensive applications owing to their flexibility, mobility, cost-effectiveness, and capacity for collaborative and autonomous service delivery. Empowered by intelligent algorithms, UAV swarm can exhibit cohesive behaviors and autonomously coordinate to achieve collective objectives. Nonetheless, in real-world scenarios with uncertainty and stochasticity, its performance suffers from the unstable information exchange among UAVs and inefficient data sampling. In this paper, we introduce a metaverse-based UAV swarm system, where monitoring, observation, analysis, and simulation can be realized collaboratively and virtually. Within the metaverse, virtual service providers (VSPs) utilize digital twin (DT) to generate and render virtual sub-worlds, while providing diverse virtual services. In particular, the VSP trains the learning model using high-fidelity data from the physical world, formulates optimal decisions for diverse tasks, and returns these decisions to the UAV swarm for the execution of the corresponding tasks. Since synchronization between two worlds needs frequent data exchange, we employ the semantic communication technique in our system which could reduce communication latency by transmitting only the semantic information. In such design, UAVs as workers are employed to collect data and provide extracted semantic information to the VSPs. Moreover, we propose a hierarchical framework to investigate the reliability and sustainability of the metaverse-based UAV swarm system. In the lower layer, we design a worker selection scheme to determine reliable UAVs for data synchronization. In the upper layer, we consider deep learning (DL)-based auction as the incentive mechanism for resource allocation in semantic information trading between UAV swarm and VSPs.

UAV-assisted Semantic Communication with Hybrid Action Reinforcement Learning

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

A Hybrid Framework of Reinforcement Learning and Convex Optimization for UAV-Based Autonomous Metaverse Data Collection

UAV aided Metaverse over Wireless Communications: A Reinforcement Learning Approach

Covert UAV Data Transmission Via Semantic Communication: A DRL-Driven Joint Position and Power Optimization Method

Matching combined multi-agent reinforcement learning for uav secure data dissemination

UAV-Aided Partial Task Offloading for Integrated Sensing, Computation, and Communications Systems via Deep Reinforcement Learning

Mean-Field Multi-Agent Reinforcement Learning for UAV Assisted Secure Data Dissemination.

UAV-Enabled Diverse Data Collection Via Integrated Sensing and Communication Functions Based on Deep Reinforcement Learning

Efficient Resource Allocation for Building the Metaverse with UAVs: A Quantum Collective Reinforcement Learning Approach

Distributed UAV Swarm for Device-Free Integrated Sensing and Communication Relying on Multi-Agent Reinforcement Learning

Lyapunov-guided Deep Reinforcement Learning for Semantic-aware AoI Minimization in UAV-assisted Wireless Networks

Semantic-aware UAV Swarm Coordination in the Metaverse: A Reputation-based Incentive Mechanism

Deep Reinforcement Learning Based Resource Allocation and Trajectory Planning in Integrated Sensing and Communications UAV Network

Blocklength Allocation and Power Control in UAV-Assisted URLLC System via Multi-agent Deep Reinforcement Learning

A deep reinforcement learning framework and its implementation for UAV-aided covert communication

User-centric Heterogeneous-action Deep Reinforcement Learning for Virtual Reality in the Metaverse over Wireless Networks

QoI-Aware Mobile Crowdsensing for Metaverse by Multi-Agent Deep Reinforcement Learning

Integrating LEO Satellite and UAV Relaying via Reinforcement Learning for Non-Terrestrial Networks

Multi-Agent DRL for Air-to-Ground Communication Planning in UAV-Enabled IoT Networks

Meta-Reinforcement Learning for UAV-Assisted Mobile Edge Computing of Virtual Reality Services.