Abstract:With the increasing demands on interactive video applications, how to adapt video bit rate to avoid network congestion has become critical, since congestion results in self-inflicted delay and packet loss which deteriorate the quality of real-time video service. The existing congestion control is hard to simultaneously achieve low latency, high throughput, good adaptability and fair bandwidth allocation, mainly because of the hardwired control strategy and egocentric convergence objective. To address these issues, we propose an end-to-end statistical learning based congestion control, named Iris. By exploring the underlying principles of self-inflicted delay, we reveal that congestion delay is determined by sending rate, receiving rate and network status, which inspires us to control video bit rate using a statistical-learning congestion control model. The key idea of Iris is to force all flows to converge to the same queue load, and adjust the bit rate by the model. All flows keep a small and fixed number of packets queuing in the network, thus the fair bandwidth allocation and low latency are both achieved. Besides, the adjustment step size of sending rate is updated by online learning, to better adapt to dynamically changing networks. We carried out extensive experiments to evaluate the performance of Iris, with the implementations of transport layer (UDP) and application layer (QUIC) respectively. The testing environment includes emulated network, real-world Internet and commercial LTE networks. Compared against TCP flavors and state-of-the-art protocols, Iris is able to achieve high bandwidth utilization, low latency and good fairness concurrently. Especially over QUIC, Iris is able to increase the video bitrate up to 25%, and PSNR up to 1dB.

HybridRTS: A Hybrid Congestion Control Framework with Rule and Reinforcement Learning for Low-Latency WebRTC Live Video Streaming

TRCC: Transferable Congestion Control with Reinforcement Learning

A Multi-objective Reinforcement Learning Perspective on Internet Congestion Control

Deep Reinforcement Learning for Smart City Communication Networks

Congestion Control Design of Multicast QUIC Based on Reinforcement Learning

Reinforcement Learning Based Cross-Layer Congestion Control for Real-Time Communication

Real-time rate control of WebRTC video streams in 5G networks: Improving quality of experience with Deep Reinforcement Learning

Congestion Control for Web Real-Time Communication

Learning-based Congestion Control for Internet Video Communication over Wireless Networks

Statistical Learning Based Congestion Control for Real-time Video Communication

Cross: A Delay Based Congestion Control Method for RTP Media

A Congestion Control Algorithm for Live Video Streaming in Dynamic Network

RAN Information-Assisted TCP Congestion Control Using Deep Reinforcement Learning with Reward Redistribution

Reinforcement learning for bandwidth estimation and congestion control in real-time communications

Resource Allocation for Video Streaming in Heterogeneous Cognitive Vehicular Networks.

Research on Adaptive Congestion Control Based on RTT

Meet Challenges of RTT Jitter, A Hybrid Internet Congestion Control Algorithm

Reinforcement Learning Based Congestion Control in a Real Environment.

Delay-constrained rate control for real-time video streaming over wireless networks

QARC: Video Quality Aware Rate Control for Real-Time Video Streaming Based on Deep Reinforcement Learning.

Dynamic TCP Initial Windows and Congestion Control Schemes Through Reinforcement Learning