Abstract:With the merit of containing full panoramic content in one camera, Virtual Reality (VR) and 360-degree videos have attracted more and more attention in the field of industrial cloud manufacturing and training. Industrial Internet of Things (IoT), where many VR terminals needed to be online at the same time, can hardly guarantee VR's bandwidth requirement. However, by making use of users' quality of experience (QoE) awareness factors, including the relative moving speed and depth difference between the viewpoint and other content, bandwidth consumption can be reduced. In this paper, we propose OFB-VR (Optical Flow Based VR), an interactive method of VR streaming that can make use of VR users' QoE awareness to ease the bandwidth pressure. The Just-Noticeable Difference through Optical Flow Estimation (JND-OFE) is explored to quantify users' awareness of quality distortion in 360-degree videos. Accordingly, a novel 360-degree videos QoE metric based on PSNR and JND-OFE (PSNR-OF) is proposed. With the help of PSNR-OF, OFB-VR proposes a versatile-size tiling scheme to lessen the tiling overhead. A Reinforcement Learning(RL) method is implemented to make use of historical data to perform Adaptive BitRate(ABR). For evaluation, we take two prior VR streaming schemes, Pano and Plato, as baselines. Vast evaluations show that our system can increase the mean PSNR-OF score by 9.5-15.8% while maintaining the same rebuffer ratio compared with Pano and Plato in a fluctuate LTE bandwidth dataset. Evaluation results show that OFB-VR is a promising prototype for actual interactive industrial VR. A prototype of OFB-VR can be found in <a class="link-external link-https" href="https://github.com/buptexplorers/OFB-VR" rel="external noopener nofollow">this https URL</a>.

VMP360

MP-VR: An MPTCP-Based Adaptive Streaming Framework for 360-degree Virtual Reality Videos

Optimal Viewport-Adaptive 360-Degree Video Streaming Against Random Head Movement.

Viewport-adaptive navigable 360-degree video delivery

EPASS360: QoE-Aware 360-Degree Video Streaming over Mobile Devices

360Probdash

Reinforcement Learning Driven Adaptive VR Streaming with Optical Flow Based QoE

Probabilistic Viewport Adaptive Streaming for 360-Degree Videos

Pano: Optimizing 360° Video Streaming with a Better Understanding of Quality Perception

TILE-BASED QOE-DRIVEN HTTP/2 STREAMING SYSTEM FOR 360 VIDEO

A Measurement Study of Oculus 360 Degree Video Streaming

RAM360: Robust Adaptive Multi-Layer 360$^\circ$ Video Streaming with Lyapunov Optimization.

Increasing the Quality of 360° Video Streaming by Transitioning between Viewport Quality Adaptation Mechanisms

OPV: Bias Correction Based Optimal Probabilistic Viewport-Adaptive Streaming for 360-Degree Video

MiniView Layout for Bandwidth-Efficient 360-Degree Video

CUB360: Exploiting Cross-Users Behaviors for Viewport Prediction in 360 Video Adaptive Streaming

An Optimal Spatial-Temporal Smoothness Approach for Tile-Based 360-Degree Video Streaming

TVG-Streaming : Learning User Behaviors for QoE-Optimized 360-Degree Video Streaming

Synergistic Temporal-Spatial User-Aware Viewport Prediction for Optimal Adaptive 360-Degree Video Streaming

Design and Analysis of MEC- and Proactive Caching-Based 360 Mobile VR Video Streaming

A Hierarchical Buffer Management Approach to Rate Adaptation for 360-Degree Video Streaming