Abstract:In this paper, the problem of enhancing the quality of virtual reality (VR) services is studied for an indoor terahertz (THz)/visible light communication (VLC) wireless network. In the studied model, small base stations (SBSs) transmit high-quality VR images to VR users over THz bands and light-emitting diodes (LEDs) provide accurate indoor positioning services for them using VLC. Here, VR users move in real time and their movement patterns change over time according to their applications, where both THz and VLC links can be blocked by the bodies of VR users. To control the energy consumption of the studied THz/VLC wireless VR network, VLC access points (VAPs) must be selectively turned on so as to ensure accurate and extensive positioning for VR users. Based on the user positions, each SBS must generate corresponding VR images and establish THz links without body blockage to transmit the VR content. The problem is formulated as an optimization problem whose goal is to maximize the reliability of the VR network by selecting the appropriate VAPs to be turned on and controlling the user association with SBSs. To solve this problem, a policy gradient-based reinforcement learning (RL) algorithm that adopts a meta-learning approach is proposed. The proposed meta policy gradient (MPG) algorithm enables the trained policy to quickly adapt to new user movement patterns. In order to solve the problem of maximizing the average number of successfully served users for VR scenarios with a large number of users, a dual method based MPG algorithm (D-MPG) with a low complexity is proposed. Simulation results demonstrate that, compared to the trust region policy optimization algorithm (TRPO), the proposed MPG and D-MPG algorithms yield up to 26.8% and 21.9% improvement in the reliability as well as 81.2% and 87.5% gains in the convergence speed, respectively.

Meta-Reinforcement Learning for Immersive Virtual Reality over THz/VLC Wireless Networks

Meta-Reinforcement Learning for Reliable Communication in THz/VLC Wireless VR Networks

Tile-based Proactive Virtual Reality Streaming Via Online Hierarchial Learning

Learning-Based Low-Latency VIoT Video Streaming Against Jamming and Interference

Learning-based Strategy for RIS-Assisted Terahertz Virtual Reality Networks

Feeling of Presence Maximization: mmWave-Enabled Virtual Reality Meets Deep Reinforcement Learning

User-centric Heterogeneous-action Deep Reinforcement Learning for Virtual Reality in the Metaverse over Wireless Networks

Learning-based Prediction, Rendering and Transmission for Interactive Virtual Reality in RIS-Assisted Terahertz Networks

Meta-Reinforcement Learning for UAV-Assisted Mobile Edge Computing of Virtual Reality Services.

Virtual Reality over Wireless Networks: Quality-of-Service Model and Learning-Based Resource Management

Virtual Reality in Metaverse over Wireless Networks with User-centered Deep Reinforcement Learning

QoE Optimization for Virtual Reality Services in Multi-RIS-Assisted Terahertz Wireless Networks

An Adaptive Wireless Virtual Reality Framework in Future Wireless Networks: A Distributed Learning Approach

Proactive 3C Resource Allocation for Wireless Virtual Reality Using Deep Reinforcement Learning.

Power and Interference Control for VLC-Based UDN: A Reinforcement Learning Approach.

Resource Management for Wireless Virtual Reality: Machine Learning Meets Multi-Attribute Utility

Multi-Objective Reinforcement Learning Towards User's Targeted VR QoE

Learning-based Prediction, Rendering and Association Optimization for MEC-enabled Wireless Virtual Reality (VR) Network

Learning-based Prediction and Uplink Retransmission for Wireless Virtual Reality (VR) Network

Virtual Reality Traffic Prioritization for Wi-Fi Quality of Service Improvement using Machine Learning Classification Techniques

Cooperative Caching, Rendering, and Beamforming for RIS-Assisted Wireless Virtual Reality Networks