Abstract:Extended Reality (XR) is an important service in the 5G network and in future 6G networks. In contrast to traditional video on demand services, real-time XR video is transmitted frame-by-frame, requiring low latency and being highly sensitive to network fluctuations. In this paper, we model the quality of experience (QoE) for real-time XR video transmission on a frame-by-frame basis. Based on the proposed QoE model, we formulate an optimization problem that maximizes QoE with constraints on wireless resources and long-term energy consumption. We utilize Lyapunov optimization to transform the original problem into a single-frame optimization problem and then allocate wireless subchannels. We propose an adaptive XR video bitrate algorithm that employs a Long Short Term Memory (LSTM) based Deep Q-Network (DQN) algorithm for video bitrate selection. Through numerical results, we show that our proposed algorithm outperforms the baseline algorithms, with the average QoE improvements of 0.04 to 0.46. Specifically, compared to baseline algorithms, the proposed algorithm reduces average video quality variations by 29% to 50% and improves the frame transmission success rate by 5% to 48%.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to optimize the Quality of Experience (QoE) of real - time Extended Reality (XR) video transmission in wireless networks while meeting long - term energy consumption constraints. Specifically, the paper focuses on how to effectively utilize limited wireless resources for frame - by - frame video transmission while ensuring low latency and high video quality. Since real - time XR videos are highly sensitive to network fluctuations and, compared with traditional on - demand video services, real - time XR videos need to be transmitted frame by frame, which brings greater technical challenges. Therefore, the paper proposes an optimization problem based on the QoE model, aiming to maximize QoE while considering the limitations of wireless resource allocation and long - term energy consumption. To achieve this goal, the paper adopts the Lyapunov optimization method to transform the original problem into a single - frame optimization problem, and further decomposes it into a sub - channel allocation sub - problem and a bit - rate selection sub - problem. For the bit - rate selection sub - problem, the paper proposes a Long Short - Term Memory (LSTM) - based Deep Q - Network (DQN) algorithm, which guides the bit - rate selection of the current real - time XR video through historical bit - rates and frame transmission states, thereby improving the user's QoE. The experimental results show that the proposed algorithm outperforms the baseline algorithms in both the simulated environment and the real - system environment, with the average QoE increasing by between 0.04 and 0.46. In addition, this algorithm also significantly reduces the variation in video quality (by 29% to 50%) and improves the frame - transmission success rate (by 5% to 48%). These improvements prove the effectiveness of the proposed method in optimizing the QoE of real - time XR video transmission.

Quality of Experience Optimization for Real-time XR Video Transmission with Energy Constraints

Quality of Experience Oriented Cross-layer Optimization for Real-time XR Video Transmission

Real-time Extended Reality Video Transmission Optimization Based on Frame-priority Scheduling

QoE-based Deep Reinforcement Learning for Resource Allocation in Real Time XR Video Transmission

QoE Fairness Resource Allocation in Digital Twin-Enabled Wireless Virtual Reality Systems

Improving Quality of Experience by Adaptive Video Streaming with Super-Resolution

A QoE-based 360° Video Adaptive Bitrate Delivery and Caching Scheme for C-RAN

User-Perceived QoE Adaptation for Accelerated Playback in Mobile Video Streaming

QoE-Driven Video Transmission: Energy-Efficient Multi-UAV Network Optimization

Extended Reality over 3GPP 5G-Advanced New Radio: Link Adaptation Enhancements

Q2oE: Balancing QoE Fairness and Preference for Video Streaming from Cooperative Edge Servers

Towards Optimal Real-time Volumetric Video Streaming: A Rolling Optimization and Deep Reinforcement Learning Based Approach

Reinforcement Learning Driven Adaptive VR Streaming with Optical Flow Based QoE

Optimal Wireless Streaming of Multi-Quality 360 VR Video By Exploiting Natural, Relative Smoothness-Enabled, and Transcoding-Enabled Multicast Opportunities

QoE-Driven Joint Optimization of Segment Adaptation and Resource Allocation for DASH Clients over LTE Networks

Attention-based QoE-aware Digital Twin Empowered Edge Computing for Immersive Virtual Reality

Multiuser Video Streaming Rate Adaptation: A Physical Layer Resource-Aware Deep Reinforcement Learning Approach

Multisite gaming streaming optimization over virtualized 5G environment using Deep Reinforcement Learning techniques

QoE Driven Resource Allocation in Next Generation Wireless Networks.

Optimal Multi-Quality Multicast for 360 Virtual Reality Video