Abstract:This paper investigates adaptive streaming of one or multiple tiled 360 videos from a multi-antenna base station (BS) to one or multiple single-antenna users, respectively, in a multi-carrier wireless system. We aim to maximize the video quality while keeping rebuffering time small via encoding rate adaptation at each group of pictures (GOP) and transmission adaptation at each (transmission) slot. To capture the impact of field-of-view (FoV) prediction, we consider three cases of FoV viewing probability distributions, i.e., perfect, imperfect, and unknown FoV viewing probability distributions, and use the average total utility, worst average total utility, and worst total utility as the respective performance metrics. In the single-user scenario, we optimize the encoding rates of the tiles, encoding rates of the FoVs, and transmission beamforming vectors for all subcarriers to maximize the total utility in each case. In the multi-user scenario, we adopt rate splitting with successive decoding and optimize the encoding rates of the tiles, encoding rates of the FoVs, rates of the common and private messages, and transmission beamforming vectors for all subcarriers to maximize the total utility in each case. Then, we separate the challenging optimization problem into multiple tractable problems in each scenario. In the single-user scenario, we obtain a globally optimal solution of each problem using transformation techniques and the Karush-Kuhn-Tucker (KKT) conditions. In the multi-user scenario, we obtain a KKT point of each problem using the concave-convex procedure (CCCP). Finally, numerical results demonstrate that the proposed solutions achieve notable gains in quality, quality variation, and rebuffering time over existing schemes in all three cases. To the best of our knowledge, this is the first work revealing the impact of FoV prediction on the performance of adaptive streaming of tiled 360 videos.

Compass: A Prefetching Framework with Viewport Patching for 360° Video Streaming

Optimal Viewport-Adaptive 360-Degree Video Streaming Against Random Head Movement.

Synergistic Temporal-Spatial User-Aware Viewport Prediction for Optimal Adaptive 360-Degree Video Streaming

The Prefetch Aggressiveness Tradeoff in 360$^{\circ}$ Video Streaming

OPV: Bias Correction Based Optimal Probabilistic Viewport-Adaptive Streaming for 360-Degree Video

Probabilistic Viewport Adaptive Streaming for 360-Degree Videos

360Probdash

CUB360: Exploiting Cross-Users Behaviors for Viewport Prediction in 360 Video Adaptive Streaming

Adaptive Streaming of 360 Videos With Perfect, Imperfect, and Unknown FoV Viewing Probabilities in Wireless Networks

VMP360

RAM360: Robust Adaptive Multi-Layer 360$^\circ$ Video Streaming with Lyapunov Optimization.

Viewport Prediction for Live 360-Degree Mobile Video Streaming Using User-Content Hybrid Motion Tracking

Viewport-adaptive navigable 360-degree video delivery

Progressive Frame Patching for FoV-based Point Cloud Video Streaming

Bandwidth-Efficient Multi-video Prefetching for Short Video Streaming

Viewport Adaptation-Based Immersive Video Streaming: Perceptual Modeling and Applications.

On the Effectiveness of Offset Projections for 360-Degree Video Streaming.

CoLive: an Edge-Assisted Online Learning Framework for Viewport Prediction in 360° Live Streaming

Pano: Optimizing 360° Video Streaming with a Better Understanding of Quality Perception

Optimizing Mobile-Friendly Viewport Prediction for Live 360-Degree Video Streaming

EPASS360: QoE-Aware 360-Degree Video Streaming over Mobile Devices