Abstract:Remote communication has rapidly become a part of everyday life in both professional and personal contexts. However, popular video conferencing applications present limitations in terms of quality of communication, immersion and social meaning. VR remote communication applications offer a greater sense of co-presence and mutual sensing of emotions between remote users. Previous research on these applications has shown that realistic point cloud user reconstructions offer better immersion and communication as compared to synthetic user avatars. However, photorealistic point clouds require a large volume of data per frame and are challenging to transmit over bandwidth-limited networks. Recent research has demonstrated significant improvements to perceived quality by optimizing the usage of bandwidth based on the position and orientation of the user's viewport with user-adaptive streaming. In this work, we developed a real-time VR communication application with an adaptation engine that features tiled user-adaptive streaming based on user behaviour. The application also supports traditional network adaptive streaming. The contribution of this work is to evaluate the impact of tiled user-adaptive streaming on quality of communication, visual quality, system performance and task completion in a functional live VR remote communication system. We perform a subjective evaluation with 33 users to compare the different streaming conditions with a neck exercise training task. As a baseline, we use uncompressed streaming requiring ca. 300Mbps and our solution achieves similar visual quality with tiled adaptive streaming at 14Mbps. We also demonstrate statistically significant gains to the quality of interaction and improvements to system performance and CPU consumption with tiled adaptive streaming as compared to the more traditional network adaptive streaming.

Performance Evaluation of Transport Protocols and Roadmap to a High-Performance Transport Design for Immersive Applications

On the Way to Holographic-Type Communications: Perspectives and Enabling Technologies

Traffic Characteristics of Extended Reality

Towards Enabling Next Generation Societal Virtual Reality Applications for Virtual Human Teleportation

Efficient communication approach in HLA-based distributed simulation for VR application

Challenges And Road Ahead For Wireless Networks To Serve Immersive Human Centric Applications

Challenges in Implementing Low-Latency Holographic-Type Communication Systems

Traffic Characteristics of Virtual Reality over Edge-enabled Wi-Fi Networks

Remote Production for Live Holographic Teleportation Applications in 5G Networks

Evaluating Transport Protocols on 5G for Mobile Augmented Reality

Future Networking Challenges: The Case of Mobile Augmented Reality

Towards an Evolved Immersive Experience: Exploring 5G- and Beyond-Enabled Ultra-Low-Latency Communications for Augmented and Virtual Reality

Providing High Capacity for AR/VR traffic in 5G Systems with Multi-Connectivity

Virtual Reality Wireless Mobile Walkthrough Framework

Realizing XR Applications Using 5G-Based 3D Holographic Communication and Mobile Edge Computing

Toward Immersive Communications in 6G

Communication, Computing and Caching for Mobile VR Delivery: Modeling and Trade-off

Towards Holographic Video Communications: A Promising AI-driven Solution

Evaluating the Impact of Tiled User-Adaptive Real-Time Point Cloud Streaming on VR Remote Communication

Wireless Access to Ultimate Virtual Reality 360-Degree Video At Home

Visible Light Communication for Next Generation Untethered Virtual Reality Systems