Abstract:Smart city communication networks hold the promise of harnessing the Internet of Things, smart devices, intelligent energy grids, autonomous cars, and many other data architectures to improve quality of life for every citizen. As time and progress have gradually shifted this concept from an idea into a reality, the possibilities for what services a smart city might provide have exploded. Along with that expansion, the number of devices that may need to be supported across a communications network has multiplied enormously. However, existing congestion control protocols are not equipped to support this higher requirement for network performance. New protocols are needed to provide higher data throughputs, reduce queuing delays and packet loss, and maintain stable and reliable communications pathways. The end-to-end congestion control protocol presented in this article does all these things. Called high throughput congestion control (HTCC), the framework takes full advantage of reinforcement learning and a fast growth algorithm to adaptively control the bytes in flight across the network's links to suit the prevailing network conditions. The result is a protocol that not only finds the optimal tradeoff between throughput, latency, and packet loss, but also significantly speeds up the learning process to avoid wasting network resources, use all free bandwidth and maximize network utilization. A comprehensive set of experiments with HTCC and six state-of-the-art protocols-Copa, PCC Vivace, PCC-Allegro, TCP Cubic, TaoVA-100x, and FillP-Sheep-demonstrate that, in most conditions, HTCC is able to make the best tradeoff between throughput, delay, and loss rate.

Intelligent Routing Strategy in the Internet of Things Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Smart City Communication Networks

Intelligent Orchestrating of IoT Microservices Based on Reinforcement Learning

A deep reinforcement learning-based multi-optimality routing scheme for dynamic IoT networks

Deep Reinforcement Learning for Router Selection in Network with Heavy Traffic

Adaptive Ant-Based Dynamic Routing Algorithm

Deep Reinforcement Learning-Based Intelligent Security Forwarding Strategy for VANET

Deep-Reinforcement-Learning-Based Intelligent Routing Strategy for FANETs

A Deep Reinforcement Learning-based Routing Scheme with Two Modes for Dynamic Networks

Packet Routing Against Network Congestion: A Deep Multi-agent Reinforcement Learning Approach

GTD3-NET: A deep reinforcement learning-based routing optimization algorithm for wireless networks

An Intersection-Based Traffic Awareness Routing Protocol in VANETs Using Deep Reinforcement Learning

Towards Cognitive Routing based on Deep Reinforcement Learning

Reinforcement learning-based load balancing for heavy traffic Internet of Things

Energy-efficient deep Q-network: reinforcement learning for efficient routing protocol in wireless internet of things

An Intelligent Routing Method Based on Network Partition

Network Calculus-based Routing and Scheduling in Software-defined Industrial Internet of Things

A Deep Learning-Based Constrained Intelligent Routing Method

IQoR: An Intelligent QoS-aware Routing Mechanism with Deep Reinforcement Learning

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

An Intelligent Routing Algorithm Based on Prioritized Replay Double DQN for MANET