Abstract:Smart city communication networks hold the promise of harnessing the Internet of Things, smart devices, intelligent energy grids, autonomous cars, and many other data architectures to improve quality of life for every citizen. As time and progress have gradually shifted this concept from an idea into a reality, the possibilities for what services a smart city might provide have exploded. Along with that expansion, the number of devices that may need to be supported across a communications network has multiplied enormously. However, existing congestion control protocols are not equipped to support this higher requirement for network performance. New protocols are needed to provide higher data throughputs, reduce queuing delays and packet loss, and maintain stable and reliable communications pathways. The end-to-end congestion control protocol presented in this article does all these things. Called high throughput congestion control (HTCC), the framework takes full advantage of reinforcement learning and a fast growth algorithm to adaptively control the bytes in flight across the network's links to suit the prevailing network conditions. The result is a protocol that not only finds the optimal tradeoff between throughput, latency, and packet loss, but also significantly speeds up the learning process to avoid wasting network resources, use all free bandwidth and maximize network utilization. A comprehensive set of experiments with HTCC and six state-of-the-art protocols-Copa, PCC Vivace, PCC-Allegro, TCP Cubic, TaoVA-100x, and FillP-Sheep-demonstrate that, in most conditions, HTCC is able to make the best tradeoff between throughput, delay, and loss rate.

Machine Learning for Internet Congestion Control: Techniques and Challenges.

A Multi-objective Reinforcement Learning Perspective on Internet Congestion Control

TRCC: Transferable Congestion Control with Reinforcement Learning

When Machine Learning Meets Congestion Control: A Survey and Comparison

Deep Reinforcement Learning for Smart City Communication Networks

Machine Learning Based Traffic Prediction and Congestion Control Algorithms in Software Defined Networks

Congestion Control in SDN-Based Networks via Multi-Task Deep Reinforcement Learning

Machine Learning for Networking: Workflow, Advances and Opportunities

A comprehensive survey on machine learning for networking: evolution, applications and research opportunities

Towards Fair and Efficient Learning-based Congestion Control

Machine Learning Approaches for Active Queue Management: A Survey, Taxonomy, and Future Directions

Reinforcement Learning Based Congestion Control in a Real Environment.

Machine-Learning-Based Traffic Classification in Software-Defined Networks

Machine Learning-based Low Overhead Congestion Control Algorithm for Industrial NoCs

Machine Learning Empowered Intelligent Data Center Networking: A Survey

Congestion Articulation Control Using Machine Learning Technique

Intelligent Active Queue Management Using Explicit Congestion Notification

Internet Congestion Control via Deep Reinforcement Learning

Utilizing Machine Learning as a Prediction Scheme for Network Performance Metrics of Self-Clocked Congestion Control Algorithm

Machine Learning for Wireless Communication: An Overview

Machine Learning for 6G Wireless Networks: Carrying Forward Enhanced Bandwidth, Massive Access, and Ultrareliable/Low-Latency Service