Abstract:Smart city communication networks hold the promise of harnessing the Internet of Things, smart devices, intelligent energy grids, autonomous cars, and many other data architectures to improve quality of life for every citizen. As time and progress have gradually shifted this concept from an idea into a reality, the possibilities for what services a smart city might provide have exploded. Along with that expansion, the number of devices that may need to be supported across a communications network has multiplied enormously. However, existing congestion control protocols are not equipped to support this higher requirement for network performance. New protocols are needed to provide higher data throughputs, reduce queuing delays and packet loss, and maintain stable and reliable communications pathways. The end-to-end congestion control protocol presented in this article does all these things. Called high throughput congestion control (HTCC), the framework takes full advantage of reinforcement learning and a fast growth algorithm to adaptively control the bytes in flight across the network's links to suit the prevailing network conditions. The result is a protocol that not only finds the optimal tradeoff between throughput, latency, and packet loss, but also significantly speeds up the learning process to avoid wasting network resources, use all free bandwidth and maximize network utilization. A comprehensive set of experiments with HTCC and six state-of-the-art protocols-Copa, PCC Vivace, PCC-Allegro, TCP Cubic, TaoVA-100x, and FillP-Sheep-demonstrate that, in most conditions, HTCC is able to make the best tradeoff between throughput, delay, and loss rate.

A Deep Reinforcement Learning Based Congestion Control Mechanism for NDN.

Deep Reinforcement Learning for Smart City Communication Networks

TRCC: Transferable Congestion Control with Reinforcement Learning

IEACC: an Intelligent Edge-Aided Congestion Control Scheme for Named Data Networking with Deep Reinforcement Learning.

A Receiver-Driven Named Data Networking (NDN) Congestion Control Method Based on Reinforcement Learning

Optimizing Deep-Space DTN Congestion Control Via Deep Reinforcement Learning

QCon: A Q-Learning Based Congestion Control Scheme in Named Data Networking

ACCP: adaptive congestion control protocol in named data networking based on deep learning

RLCC: Practical Learning-based Congestion Control for the Internet

DRL-based Forwarding Strategy in Named Data Networking

DECC: Achieving Low Latency in Data Center Networks with Deep Reinforcement Learning

Edge Computing Aided Congestion Control Using Neuro-Dynamic Programming in NDN

Congestion Control in SDN-Based Networks via Multi-Task Deep Reinforcement Learning

BBR based congestion control algorithm for NDN

RAN Information-Assisted TCP Congestion Control Using Deep Reinforcement Learning with Reward Redistribution

Efficient congestion control scheme based on caching strategy in NDN

Multi-Path Selection and Congestion Control for NDN: an Online Learning Approach

Internet Congestion Control via Deep Reinforcement Learning

A Rcp-Based Congestion Control Protocol In Named Data Networking

A Distributed Reinforcement Learning Approach to In-network Congestion Control

A VCP-based Congestion Control Algorithm in Named Data Networking