Abstract:Wireless virtual reality (VR) is expected to be a technology that revolutionizes human interaction and perceived media, where the quality of experience (QoE) is an important indicator to measure user service perception. However, existing schemes only consider general and time-invariant QoE optimization, which may suffer performance degradation. Moreover, it is also necessary to ensure the fairness of the individual user’s performance in wireless VR. To address these challenges, we employ digital twin technology to investigate a max-min QoE-optimal problem for wireless VR systems in this paper. Specifically, we maximize the QoE of the worst-case head-mounted displays (HDMs) client, where the QoE model is the linear weighting combination of video quality, service delay, and energy efficiency. The formulated optimization problem is characterized by multidimensional control, which jointly optimizes model selection, transmit power, computation time, and GPU-cycle frequency. Due to the mixed combinatorial features of the optimization problem, we give a low-complexity algorithm design by decoupling the optimization variables. Notably, we first obtain the allocation of the transmit power by employing the generalized fractional programming theory and the Lagrangian dual decomposition, followed by attaining the optimal allocation of GPU-cycle frequency in VR mode is derived by the proposed adaptive modified harmony search algorithm, and finally achieve the computation time by the barrier method. Meanwhile, we devise a greedy-style heuristic algorithm for mode selection. In the simulation, three baseline schemes are established as comparisons to assess the effectiveness of the proposed scheme. Meanwhile, the simulation results manifest that the proposed algorithms have good convergence performance and better increase the QoE of the DT-enabled wireless VR system compared to benchmark solutions.

Feeling of Presence Maximization: mmWave-Enabled Virtual Reality Meets Deep Reinforcement Learning

Tile-based Proactive Virtual Reality Streaming Via Online Hierarchial Learning

An Adaptive Wireless Virtual Reality Framework in Future Wireless Networks: A Distributed Learning Approach

A Deep Reinforcement Learning Strategy for MEC Enabled Virtual Reality in Telecommunication Networks

Meta-Reinforcement Learning for Immersive Virtual Reality over THz/VLC Wireless Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Learning-based Prediction, Rendering and Association Optimization for MEC-enabled Wireless Virtual Reality (VR) Network

Resource Management for Wireless Virtual Reality: Machine Learning Meets Multi-Attribute Utility

Attention-based QoE-aware Digital Twin Empowered Edge Computing for Immersive Virtual Reality

Wireless Multi-User Interactive Virtual Reality in Metaverse with Edge-Device Collaborative Computing

Proactive 3C Resource Allocation for Wireless Virtual Reality Using Deep Reinforcement Learning.

Meta-Reinforcement Learning for Reliable Communication in THz/VLC Wireless VR Networks

User-centric Heterogeneous-action Deep Reinforcement Learning for Virtual Reality in the Metaverse over Wireless Networks

Cooperative Caching, Rendering, and Beamforming for RIS-Assisted Wireless Virtual Reality Networks

QoE Fairness Resource Allocation in Digital Twin-Enabled Wireless Virtual Reality Systems

Virtual Reality over Wireless Networks: Quality-of-Service Model and Learning-Based Resource Management

Multi-Objective Reinforcement Learning Towards User's Targeted VR QoE

Learning-based Prediction, Rendering and Transmission for Interactive Virtual Reality in RIS-Assisted Terahertz Networks

Multi-Task Decision-Making for Multi-User 360 Video Processing over Wireless Networks

Federated Deep Learning for Immersive Virtual Reality over Wireless Networks.