Abstract:Over the past decade, the utilization of UAVs has witnessed significant growth, owing to their agility, rapid deployment, and maneuverability. In particular, the use of UAV-mounted 360-degree cameras to capture omnidirectional videos has enabled truly immersive viewing experiences with up to 6DoF. However, achieving this immersive experience necessitates encoding omnidirectional videos in high resolution, leading to increased bitrates. Consequently, new challenges arise in terms of latency, throughput, perceived quality, and energy consumption for real-time streaming of such content. This paper presents a comprehensive survey of research efforts in UAV-based immersive video streaming, benchmarks popular video encoding schemes, and identifies open research challenges. Initially, we review the literature on 360-degree video coding, packaging, and streaming, with a particular focus on standardization efforts to ensure interoperability of immersive video streaming devices and services. Subsequently, we provide a comprehensive review of research efforts focused on optimizing video streaming for timevarying UAV wireless channels. Additionally, we introduce a high resolution 360-degree video dataset captured from UAVs under different flying conditions. This dataset facilitates the evaluation of complexity and coding efficiency of software and hardware video encoders based on popular video coding standards and formats, including AVC/H.264, HEVC/H.265, VVC/H.266, VP9, and AV1. Our results demonstrate that HEVC achieves the best trade-off between coding efficiency and complexity through its hardware implementation, while AV1 format excels in coding efficiency through its software implementation, specifically using the libsvt-av1 encoder. Furthermore, we present a real testbed showcasing 360-degree video streaming over a UAV, enabling remote control of the drone via a 5G cellular network.

UAV-Assisted Edge Computing and Streaming for Wireless Virtual Reality: Analysis, Algorithm Design, and Performance Guarantees

Design and Analysis of MEC- and Proactive Caching-Based 360 Mobile VR Video Streaming

Meta-Reinforcement Learning for UAV-Assisted Mobile Edge Computing of Virtual Reality Services.

Deep Learning for 360 degrees Content Transmission in UAV-Enabled Virtual Reality

Joint Task Offloading, Resource Allocation, and Security Assurance for Mobile Edge Computing-Enabled UAV-Assisted VANETs

Low-Latency Mobile Virtual Reality Content Delivery for Unmanned Aerial Vehicle-Enabled Wireless Networks with Energy Constraints.

A Mobile Edge Computing Framework for Task Offloading and Resource Allocation in UAV-assisted VANETs

Joint Rendering Offloading and Resource Allocation Optimization for MEC-Assisted VR Systems

Deep Learning for 360&#x000b0; Content Transmission in UAV-Enabled Virtual Reality

Communication-and-Computing Latency Minimization for UAV-Enabled Virtual Reality Delivery Systems

UAV Immersive Video Streaming: A Comprehensive Survey, Benchmarking, and Open Challenges

Aerial Video Streaming over 3D Cellular Networks: An Environment and Channel Knowledge Map Approach

MEC-Assisted Panoramic VR Video Streaming over Millimeter Wave Mobile Networks.

Echo-Liquid State Deep Learning for $360^\circ$ Content Transmission and Caching in Wireless VR Networks with Cellular-Connected UAVs

UAV Placement for VR Reconstruction: A Tradeoff Between Resolution and Delay

Joint Resource Allocation and 3D Aerial Trajectory Design for Video Streaming in UAV Communication Systems

Converging Mobile Edge Computing and Wireless Access for Virtual Reality

UAV-Aided Low Latency Multi-Access Edge Computing

Proactive 3C Resource Allocation for Wireless Virtual Reality Using Deep Reinforcement Learning.

Mobile Edge Computing in Unmanned Aerial Vehicle Networks

Heterogeneous Service-Oriented Resource Provisioning and UAV Deployment for Aerial Edge Computing Networks