Abstract:This paper investigates adaptive streaming of one or multiple tiled 360 videos from a multi-antenna base station (BS) to one or multiple single-antenna users, respectively, in a multi-carrier wireless system. We aim to maximize the video quality while keeping rebuffering time small via encoding rate adaptation at each group of pictures (GOP) and transmission adaptation at each (transmission) slot. To capture the impact of field-of-view (FoV) prediction, we consider three cases of FoV viewing probability distributions, i.e., perfect, imperfect, and unknown FoV viewing probability distributions, and use the average total utility, worst average total utility, and worst total utility as the respective performance metrics. In the single-user scenario, we optimize the encoding rates of the tiles, encoding rates of the FoVs, and transmission beamforming vectors for all subcarriers to maximize the total utility in each case. In the multi-user scenario, we adopt rate splitting with successive decoding and optimize the encoding rates of the tiles, encoding rates of the FoVs, rates of the common and private messages, and transmission beamforming vectors for all subcarriers to maximize the total utility in each case. Then, we separate the challenging optimization problem into multiple tractable problems in each scenario. In the single-user scenario, we obtain a globally optimal solution of each problem using transformation techniques and the Karush-Kuhn-Tucker (KKT) conditions. In the multi-user scenario, we obtain a KKT point of each problem using the concave-convex procedure (CCCP). Finally, numerical results demonstrate that the proposed solutions achieve notable gains in quality, quality variation, and rebuffering time over existing schemes in all three cases. To the best of our knowledge, this is the first work revealing the impact of FoV prediction on the performance of adaptive streaming of tiled 360 videos.

TILE-BASED QOE-DRIVEN HTTP/2 STREAMING SYSTEM FOR 360 VIDEO

An Optimal Spatial-Temporal Smoothness Approach for Tile-Based 360-Degree Video Streaming

TVG-Streaming : Learning User Behaviors for QoE-Optimized 360-Degree Video Streaming

VMP360

360Probdash

EPASS360: QoE-Aware 360-Degree Video Streaming over Mobile Devices

CUBIST: High-Quality 360-Degree Video Streaming Services via Tile-based Edge Caching and FoV-Adaptive Prefetching

An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos

Scalable and resilient 360-degree-video adaptive streaming over HTTP/2 against sudden network drops

TBSR: Tile-Based 360° Video Streaming with Super-Resolution on Commodity Mobile Devices

Design and Analysis of MEC- and Proactive Caching-Based 360 Mobile VR Video Streaming

MP-VR: An MPTCP-Based Adaptive Streaming Framework for 360-degree Virtual Reality Videos

Probabilistic Viewport Adaptive Streaming for 360-Degree Videos

Streaming 360° videos to head-mounted virtual reality using DASH over QUIC transport protocol

Synergistic Temporal-Spatial User-Aware Viewport Prediction for Optimal Adaptive 360-Degree Video Streaming

Adaptive Streaming of 360 Videos With Perfect, Imperfect, and Unknown FoV Viewing Probabilities in Wireless Networks

QoE-Oriented Resource Allocation for 360-degree Video Transmission over Heterogeneous Networks

Optimal Viewport-Adaptive 360-Degree Video Streaming Against Random Head Movement.

An Original-Stream Based Solution for Smoothly Replaying High-definition Videos in Desktop Virtualization Systems.

RAM360: Robust Adaptive Multi-Layer 360$^\circ$ Video Streaming with Lyapunov Optimization.

CUB360: Exploiting Cross-Users Behaviors for Viewport Prediction in 360 Video Adaptive Streaming