Abstract:This paper presents a joint optimization strategy of task scheduling and computing resource allocation based on deep reinforcement learning algorithm for VR video services in 5G‐advanced networks. With the development of 5G networks and related hardware equipment, the demand for various VR video services including panoramic video live broadcast and immersive game is increasing day by day. Due to the explosive growth of data volume and the trend toward lightweight VR equipment, traditional local computing architecture faces problems of insufficient computing power and high cost. As an emerging computing paradigm, the remote computing architecture of cloud‐edge collaboration frees users from cumbersome local restrictions. However, edge computing resources are often limited, and the remote cloud has inconsistent network latency. Therefore, how to adaptively schedule and allocate computing resources is the key to determining VR service quality. Based on an in‐depth analysis of the characteristics of VR video services and network environments, this article first builds a cloud‐edge‐network coorperation computing and transmission architecture for VR video services. This architecture can adaptively offload concurrent computing tasks and allocate computing power to them in VR scenes based on network conditions provided by the 5G‐Advanced networks via network information exposure interface. This paper proposes a general optimization problem to maximize user experience. And a single‐slot delay optimization model was constructed. Combining convex optimization theory and deep learning algorithms, this paper designs a task scheduling and computing power allocation strategy based on deep reinforcement learning. The policy gradually learns optimal task scheduling and resource allocation decisions to maximize delay‐related rewards in the long run. This article further introduces the graph neural network under the attention mechanism to solve the problem of changes in the number of concurrent tasks. Finally, through Cloudsim simulation, this article verifies the superiority of task scheduling and computing power allocation strategies based on deep reinforcement learning compared to other common strategies in terms of resource utilization, client latency, scalability and decision time.

Content-Sensing Based Resource Allocation forDelay-Sensitive VR Video Uploading in 5G H-CRAN

Resource Allocation for Video Streaming in Heterogeneous Cognitive Vehicular Networks.

Resource allocation for virtual reality content sharing based on 5G D2D multicast communication

Providing UE-level QoS Support by Joint Scheduling and Orchestration for 5G Vran

Hierarchical Resource Allocation in Multi-Service Wireless Networks with Wireless Network Virtualization

A WMMSE-Based Contiguous Resource Scheduling Algorithm for 5G-NR Uplink

Video Transmission over Cognitive Radio Networks

Joint optimization of task scheduling and computing resource allocation for VR video services in 5G‐advanced networks

Real-time Extended Reality Video Transmission Optimization Based on Frame-priority Scheduling

SMDP-based Resource Allocation for Video Streaming in Cognitive Vehicular Networks.

Joint EPC and RAN Caching of Tiled VR Videos for Mobile Networks.

Resource Allocation for 3D Video Transmission in LTE System Based on Fuzzy Logic.

QoE-Oriented Resource Allocation for 360-degree Video Transmission over Heterogeneous Networks

Optimizing Resource Allocation for Wireless VR Services

Tile Caching for Scalable VR Video Streaming over 5G Mobile Networks.

A multipath scheduler based on cross-layer information for low-delay applications in 5G edge networks

5G Mobile Virtual Reality Optimization Solution for Communication and Computing Integration

Streaming 360-degree VR Video with Statistical QoS Provisioning in mmWave Networks from Delay and Rate Perspectives

Cross-Layer Assisted Early Congestion Control for Cloud VR Services in 5G Edge Network

Deep Learning-Based Resource Allocation for 5G Broadband TV Service

Dynamic Resource Allocation for Scalable Video Streaming in OFDMA Wireless Networks