Abstract:The increasingly complicated and diverse applications have distinct network performance demands, e.g., some desire high throughput while others require low latency. Traditional congestion controls (CC) have no perception of these demands. Consequently, literatures have explored the objective-specific algorithms, which are based on either offline training or online learning, to adapt to certain application demands. However, once generated, such algorithms are tailored to a specific performance objective function. Newly emerged performance demands in a changeable network environment require either expensive retraining (in the case of offline training), or manually redesigning a new objective function (in the case of online learning). To address this problem, we propose a novel architecture, DeepCC. It generates a CC agent that is generically applicable to a wide range of application requirements and network conditions. The key idea of DeepCC is to leverage both offline deep reinforcement learning and online fine-tuning. In the offline phase, instead of training towards a specific objective function, DeepCC trains its deep neural network model using multi-objective optimization. With the trained model, DeepCC offers near Pareto optimal policies w.r.t different user-specified trade-offs between throughput, delay, and loss rate without any redesigning or retraining. In addition, a quick online fine-tuning phase further helps DeepCC achieve the application-specific demands under dynamic network conditions. The simulation and real-world experiments show that DeepCC outperforms state-of-the-art schemes in a wide range of settings. DeepCC gains a higher target completion ratio of application requirements up to 67.4% than that of other schemes, even in an untrained environment.

Deep Reinforcement Learning Based Congestion Control for Delay-Sensitive Multimedia Streaming

A Multi-objective Reinforcement Learning Perspective on Internet Congestion Control

Deep Reinforcement Learning for Smart City Communication Networks

Congestion Control Design of Multicast QUIC Based on Reinforcement Learning

TRCC: Transferable Congestion Control with Reinforcement Learning

Delay Constrained Self Congestion Control for FGS Video Streams

Learning-based Congestion Control for Internet Video Communication over Wireless Networks

DeepCC: Multi-Agent Deep Reinforcement Learning Congestion Control for Multi-Path TCP Based on Self-Attention

Reinforcement Learning Based Congestion Control in a Real Environment.

Statistical Learning Based Congestion Control for Real-time Video Communication

DeepCC: Bridging the Gap Between Congestion Control and Applications via Multi-Objective Optimization

DeepCC: Bridging the Gap Between Congestion Control and Applications Via Multiobjective Optimization

Resource Allocation for Video Streaming in Heterogeneous Cognitive Vehicular Networks.

Congestion Control in SDN-Based Networks via Multi-Task Deep Reinforcement Learning

Rate Adaptation and Block Scheduling for Delay-sensitive Multimedia Applications.

A Deep Reinforcement Learning Framework for Optimizing Congestion Control in Data Centers

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Reinforcement learning for bandwidth estimation and congestion control in real-time communications

Real-time rate control of WebRTC video streams in 5G networks: Improving quality of experience with Deep Reinforcement Learning

DECC: Achieving Low Latency in Data Center Networks with Deep Reinforcement Learning

QoE-based Deep Reinforcement Learning for Resource Allocation in Real Time XR Video Transmission