Abstract:Remote communication has rapidly become a part of everyday life in both professional and personal contexts. However, popular video conferencing applications present limitations in terms of quality of communication, immersion and social meaning. VR remote communication applications offer a greater sense of co-presence and mutual sensing of emotions between remote users. Previous research on these applications has shown that realistic point cloud user reconstructions offer better immersion and communication as compared to synthetic user avatars. However, photorealistic point clouds require a large volume of data per frame and are challenging to transmit over bandwidth-limited networks. Recent research has demonstrated significant improvements to perceived quality by optimizing the usage of bandwidth based on the position and orientation of the user's viewport with user-adaptive streaming. In this work, we developed a real-time VR communication application with an adaptation engine that features tiled user-adaptive streaming based on user behaviour. The application also supports traditional network adaptive streaming. The contribution of this work is to evaluate the impact of tiled user-adaptive streaming on quality of communication, visual quality, system performance and task completion in a functional live VR remote communication system. We perform a subjective evaluation with 33 users to compare the different streaming conditions with a neck exercise training task. As a baseline, we use uncompressed streaming requiring ca. 300Mbps and our solution achieves similar visual quality with tiled adaptive streaming at 14Mbps. We also demonstrate statistically significant gains to the quality of interaction and improvements to system performance and CPU consumption with tiled adaptive streaming as compared to the more traditional network adaptive streaming.

Tiled-DASH VR Video Streaming: Design and Implementation

Tile-based Proactive Virtual Reality Streaming Via Online Hierarchial Learning

Performance Measurements of 360° Video Streaming to Head-Mounted Displays over Live 4G Cellular Networks

Tile Caching for Scalable VR Video Streaming over 5G Mobile Networks.

Streaming 360° videos to head-mounted virtual reality using DASH over QUIC transport protocol

Design and Analysis of MEC- and Proactive Caching-Based 360 Mobile VR Video Streaming

Mixed Tiling Scheme for Adaptive VR Streaming

Joint EPC and RAN Caching of Tiled VR Videos for Mobile Networks.

An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos

Evaluating the Impact of Tiled User-Adaptive Real-Time Point Cloud Streaming on VR Remote Communication

Spatiotemporal Rate Adaptive Tiled Scheme for 360 Sports Events

CUBIST: High-Quality 360-Degree Video Streaming Services via Tile-based Edge Caching and FoV-Adaptive Prefetching

Adaptive 360 VR Video Streaming based on MPEG-DASH SRD

Intelligent Cache and Buffer Optimization for Mobile VR Adaptive Transmission in 5G Edge Computing Networks

TBSR: Tile-Based 360° Video Streaming with Super-Resolution on Commodity Mobile Devices

Towards Tile Based Distribution Simulation in Immersive Video Streaming

MP-VR: An MPTCP-Based Adaptive Streaming Framework for 360-degree Virtual Reality Videos

Tile-Weighted Rate-Distortion Optimized Packet Scheduling for 360$^\circ$ VR Video Streaming

Virtual Reality Telepresence: 360-Degree Video Streaming with Edge-Compute Assisted Static Foveated Compression

Adaptive VR Video Data Transmission Method Using Mobile Edge Computing Based on AIoT Cloud VR

Virtual Reality Compressing and Transmitting System Based on Mobile Edge Computing