Abstract:This paper presents a joint optimization strategy of task scheduling and computing resource allocation based on deep reinforcement learning algorithm for VR video services in 5G‐advanced networks. With the development of 5G networks and related hardware equipment, the demand for various VR video services including panoramic video live broadcast and immersive game is increasing day by day. Due to the explosive growth of data volume and the trend toward lightweight VR equipment, traditional local computing architecture faces problems of insufficient computing power and high cost. As an emerging computing paradigm, the remote computing architecture of cloud‐edge collaboration frees users from cumbersome local restrictions. However, edge computing resources are often limited, and the remote cloud has inconsistent network latency. Therefore, how to adaptively schedule and allocate computing resources is the key to determining VR service quality. Based on an in‐depth analysis of the characteristics of VR video services and network environments, this article first builds a cloud‐edge‐network coorperation computing and transmission architecture for VR video services. This architecture can adaptively offload concurrent computing tasks and allocate computing power to them in VR scenes based on network conditions provided by the 5G‐Advanced networks via network information exposure interface. This paper proposes a general optimization problem to maximize user experience. And a single‐slot delay optimization model was constructed. Combining convex optimization theory and deep learning algorithms, this paper designs a task scheduling and computing power allocation strategy based on deep reinforcement learning. The policy gradually learns optimal task scheduling and resource allocation decisions to maximize delay‐related rewards in the long run. This article further introduces the graph neural network under the attention mechanism to solve the problem of changes in the number of concurrent tasks. Finally, through Cloudsim simulation, this article verifies the superiority of task scheduling and computing power allocation strategies based on deep reinforcement learning compared to other common strategies in terms of resource utilization, client latency, scalability and decision time.

Distributed Deep Reinforcement Learning Based Mode Selection and Resource Allocation for VR Transmission in Edge Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Joint optimization of task scheduling and computing resource allocation for VR video services in 5G‐advanced networks

Optimizing data transmission in 6G software defined networks using deep reinforcement learning for next generation of virtual environments

Attention-based QoE-aware Digital Twin Empowered Edge Computing for Immersive Virtual Reality

QoE-based Deep Reinforcement Learning for Resource Allocation in Real Time XR Video Transmission

Joint mode selection and resource allocation for cellular V2X communication using distributed deep reinforcement learning under 5G and beyond networks

Feeling of Presence Maximization: mmWave-Enabled Virtual Reality Meets Deep Reinforcement Learning

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

QoE Fairness Resource Allocation in Digital Twin-Enabled Wireless Virtual Reality Systems

Distributed Deep Reinforcement Learning for Resource Allocation in Digital Twin Networks

A Deep Reinforcement Learning Strategy for MEC Enabled Virtual Reality in Telecommunication Networks

Virtual Reality over Wireless Networks: Quality-of-Service Model and Learning-Based Resource Management

Deep Reinforcement Learning Based Mode Selection and Resource Allocation for Cellular V2X Communications

DRL Optimization Trajectory Generation via Wireless Network Intent-Guided Diffusion Models for Optimizing Resource Allocation

Deep reinforcement learning based resource allocation in edge-cloud gaming

Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing