Real-time rate control of WebRTC video streams in 5G networks: Improving quality of experience with Deep Reinforcement Learning

Nikita Smirnov,Sven Tomforde
DOI: https://doi.org/10.1016/j.sysarc.2024.103066
IF: 5.836
2024-01-28
Journal of Systems Architecture
Abstract:Adapting to a dynamic environment is a critical challenge in deploying robust systems that will be tasked with transmitting media streams in 5G networks. The Web Real-Time Communication (WebRTC) protocol is one of the most popular solutions for real-time communication, providing sub-second latency. This paper deals with a model-free Deep Reinforcement Learning approach designed to improve the quality of user experience by controlling the data rate of media streams transmitted in the uplink direction by a moving, remote-controlled device. The model incorporates WebRTC-compliant metrics to facilitate its integration into real-world applications and aims to maximize the value of a reward function specifically designed to match user perception of video streams. Training and evaluation are performed in an active, online manner within a 5G simulation environment based on the OMNeT++ network simulator, with the addition of key WebRTC mechanisms. The results are compared to the Google Congestion Control algorithm, a baseline WebRTC rate adaptation mechanism. The results, validated on different scenarios, demonstrate the ability of the proposed Deep Reinforcement Learning model to maintain higher rates at comparable levels of loss rate and delay times to the baseline, thus providing a better quality of experience for an operator in the remote center, resulting in the more reliable control of the device.
computer science, software engineering, hardware & architecture
What problem does this paper attempt to address?