Abstract:With the advancements of wireless network transmission technology, 2D video is hard to satisfy people's requirement for multimedia. Therefore, the high-definition 3D video that can bring a whole new viewing experience is starting to enter people's vision. However, when a tremendously large number of users play 3D video, it puts enormous computational pressure on the cloud server, which incurs high transmission latency. To release the tension, in this articl we consider a promising computing and networking architecture by incorporating Mobile Edge Computing (MEC) and Software-defined Networking (SDN) and propose a novel resource allocation model (RAM) to allocate resources and reduce delay. At the same time, we introduce the Quality of Experience (QoE) Model (QoEM), which uses information collected during 3D video playback to adaptively allocate the rate of future tiles. The model addresses the problem of assigning the best transmission speed to the block in the case of time-varying characteristicfactors during transmission. We propose an Actor-Critic-based deep reinforcement learning algorithm for viewport prediction and QoE optimization, called QoE-AC. For the differential transmission in the playback phase, we use the LSTM network for bandwidth and viewport prediction, while combining the historical information of the blocks into the Actor-Critic network as observations. The network can be adaptively assigned the best transmission speed for future tiles based on observations to maximize QoE. Finally, the experimental results show that the actual performance of the model is much better than other existing 3D video network models. Under different QoE targets, our proposed system can be adapted to all situations and has a 10%-15% performance improvement.

Off-Policy - Soft Actor-Critic-based Adaptive Streaming for 360-degree Video in Heterogeneous Wireless Networks.

DRL360: 360-Degree Video Streaming with Deep Reinforcement Learning

Cross Layer Optimization and Distributed Reinforcement Learning for Wireless 360° Video Streaming

Soft Actor-Critic Algorithm for 360-Degree Video Streaming with Long-Term Viewport Prediction

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Improving 360-Degree Video Streaming with Adaptive Path Scheduling

Deep Reinforcement Learning Based Adaptive 360-Degree Video Streaming with Field of View Joint Prediction

PAAS: a preference-aware deep reinforcement learning approach for 360° video streaming

Perceptual Quality Aware Adaptive 360-Degree Video Streaming with Deep Reinforcement Learning

Sequential Reinforced 360-Degree Video Adaptive Streaming with Cross-user Attentive Network

Deep Reinforcement Learning-based Rate Adaptation for Adaptive 360-Degree Video Streaming

Robust Saliency-Driven Quality Adaptation for Mobile 360-Degree Video Streaming

QoE-Aware 3D Video Streaming via Deep Reinforcement Learning in Software Defined Networking Enabled Mobile Edge Computing

MADRL-Based Joint Edge Caching and Bitrate Selection for Multicategory 360° Video Streaming

TS360: A Two-Stage Deep Reinforcement Learning System for 360-Degree Video Streaming

A Hybrid Control Scheme for 360-Degree Dynamic Adaptive Video Streaming Over Mobile Devices

Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming

QoE-based Deep Reinforcement Learning for Resource Allocation in Real Time XR Video Transmission

QoE-Oriented Resource Allocation for 360-degree Video Transmission over Heterogeneous Networks

MADRL-Based Rate Adaptation for 360° Video Streaming With Multiviewpoint Prediction

Multiuser Video Streaming Rate Adaptation: A Physical Layer Resource-Aware Deep Reinforcement Learning Approach