Abstract:This paper investigates adaptive streaming of one or multiple tiled 360 videos from a multi-antenna base station (BS) to one or multiple single-antenna users, respectively, in a multi-carrier wireless system. We aim to maximize the video quality while keeping rebuffering time small via encoding rate adaptation at each group of pictures (GOP) and transmission adaptation at each (transmission) slot. To capture the impact of field-of-view (FoV) prediction, we consider three cases of FoV viewing probability distributions, i.e., perfect, imperfect, and unknown FoV viewing probability distributions, and use the average total utility, worst average total utility, and worst total utility as the respective performance metrics. In the single-user scenario, we optimize the encoding rates of the tiles, encoding rates of the FoVs, and transmission beamforming vectors for all subcarriers to maximize the total utility in each case. In the multi-user scenario, we adopt rate splitting with successive decoding and optimize the encoding rates of the tiles, encoding rates of the FoVs, rates of the common and private messages, and transmission beamforming vectors for all subcarriers to maximize the total utility in each case. Then, we separate the challenging optimization problem into multiple tractable problems in each scenario. In the single-user scenario, we obtain a globally optimal solution of each problem using transformation techniques and the Karush-Kuhn-Tucker (KKT) conditions. In the multi-user scenario, we obtain a KKT point of each problem using the concave-convex procedure (CCCP). Finally, numerical results demonstrate that the proposed solutions achieve notable gains in quality, quality variation, and rebuffering time over existing schemes in all three cases. To the best of our knowledge, this is the first work revealing the impact of FoV prediction on the performance of adaptive streaming of tiled 360 videos.

TBSR: Tile-Based 360° Video Streaming with Super-Resolution on Commodity Mobile Devices

An Optimal Spatial-Temporal Smoothness Approach for Tile-Based 360-Degree Video Streaming

TILE-BASED QOE-DRIVEN HTTP/2 STREAMING SYSTEM FOR 360 VIDEO

Performance Measurements of 360° Video Streaming to Head-Mounted Displays over Live 4G Cellular Networks

RTCSR: Zero-latency Aware Super-resolution for WebRTC Mobile Video Streaming

Adaptive 360 VR Video Streaming: Divide and Conquer!

Improving Quality of Experience by Adaptive Video Streaming with Super-Resolution

Tile-size aware bitrate allocation for adaptive 360 video streaming

Adaptive 360 VR Video Streaming based on MPEG-DASH SRD

Tile-Weighted Rate-Distortion Optimized Packet Scheduling for 360$^\circ$ VR Video Streaming

MP-VR: An MPTCP-Based Adaptive Streaming Framework for 360-degree Virtual Reality Videos

CUBIST: High-Quality 360-Degree Video Streaming Services via Tile-based Edge Caching and FoV-Adaptive Prefetching

TVG-Streaming : Learning User Behaviors for QoE-Optimized 360-Degree Video Streaming

TileSR: Accelerate On-Device Super-Resolution with Parallel Offloading in Tile Granularity

Spatiotemporal Rate Adaptive Tiled Scheme for 360 Sports Events

STC: Enabling 16K VR Streaming on Mobile Platforms with FoV Tracking

STC: FoV Tracking Enabled High-Quality 16K VR Video Streaming on Mobile Platforms

Adaptive Streaming of 360 Videos With Perfect, Imperfect, and Unknown FoV Viewing Probabilities in Wireless Networks

Design and Analysis of MEC- and Proactive Caching-Based 360 Mobile VR Video Streaming

Robust Saliency-Driven Quality Adaptation for Mobile 360-Degree Video Streaming

Toward High-Quality Low-Latency 360° Video Streaming With Edge–Client Collaborative Caching and Super-Resolution