Abstract:To provide excellent visual experience for customers, virtual reality (VR) sources require higher resolutions and better visual quality than traditional picture sequences. The content of a VR video can be mapped into a sphere by playing devices to present a 360 scene, which is usually called VR360 in industrial community. The most popular formats for VR360 sources are the equirectangular projection (ERP) and the cubemap projection (CMP). Both ERP and CMP pictures can be effectively projected to a virtual three-dimensional spherical surface for rendering. It brings a new challenge to the compression of VR video sources, which is how to reallocate proper bit-rate to match mainstream projection formats. The most intuitive way to deal with this challenge is to empirically assign a fixed quantization parameter (QP) to each coding unit according to its position, which evidently lacks precision, rationality, and thus, degrades coding performance. This research proposes a new entropy equilibrium optimization (EEO) methodology to enhance the coding performance of VR360 videos. Specifically, we develop a spherical bit-rate equalization strategy to obtain a block-level Lagrangian multiplier for the rate-distortion optimization process in video coding. The appropriate QP value for each block is then dynamically determined in accordance with its. Based on our EEO methodology, we develop two algorithms, EEOA-ERP and EEOA-CMP, to enhance compression efficiency for the ERP and CMP pictures, respectively. Experimental results demonstrate that both algorithms achieve significant BD-Rate savings and outperform the HM16.17 platform for all-intra (AI), low-delay (LD) and random-access (RA) configurations, respectively. Concretely, compared with the state-of-the-art algorithm WSU-ERP, the proposed EEOA-ERP achieves BD-Rate saving of 0.37% in LD configuration. Furthermore, the proposed EEOA-CMP gains 2.6% on objective quality in RA configuration when compared with the HM16.17 VR CMP under the common test condition.

Mapping Wireless Link Performance to 360-Degree VR QoE

Streaming 360-degree VR Video with Statistical QoS Provisioning in mmWave Networks from Delay and Rate Perspectives

Design and Analysis of MEC- and Proactive Caching-Based 360 Mobile VR Video Streaming

QoE-Oriented Resource Allocation for 360-degree Video Transmission over Heterogeneous Networks

QoE Optimization for Virtual Reality Services in Multi-RIS-Assisted Terahertz Wireless Networks

Optimal Multi-Quality Multicast for 360 Virtual Reality Video

Optimal Wireless Streaming of Multi-Quality 360 VR Video By Exploiting Natural, Relative Smoothness-Enabled, and Transcoding-Enabled Multicast Opportunities

Reinforcement Learning Driven Adaptive VR Streaming with Optical Flow Based QoE

UAV-Assisted Edge Computing and Streaming for Wireless Virtual Reality: Analysis, Algorithm Design, and Performance Guarantees

QoE Fairness Resource Allocation in Digital Twin-Enabled Wireless Virtual Reality Systems

Traffic Characteristics of Virtual Reality over Edge-enabled Wi-Fi Networks

Wireless Access to Ultimate Virtual Reality 360-Degree Video At Home

NOMA based VR Video Transmissions Exploiting User Behavioral Coherence

WiserVR: Semantic Communication Enabled Wireless Virtual Reality Delivery

MP-VR: An MPTCP-Based Adaptive Streaming Framework for 360-degree Virtual Reality Videos

Assessing the Impact of Network Quality-of-Service on Metaverse Virtual Reality User Experience

Video Coding Optimization for Virtual Reality 360-Degree Source

Multi-Task Decision-Making for Multi-User 360 Video Processing over Wireless Networks

Modeling Gamer Quality-of-Experience Using a Real Cloud VR Gaming Testbed.

Spatial Perceptual Quality Aware Adaptive Volumetric Video Streaming

Experimental Evaluation of Interactive Edge/Cloud Virtual Reality Gaming over Wi-Fi using Unity Render Streaming