iCoCoA: intelligent congestion control algorithm for CoAP using deep reinforcement learning
Praveen Kumar Donta,Satish Narayana Srirama,Tarachand Amgoth,Chandra Sekhara Rao Annavarapu
DOI: https://doi.org/10.1007/s12652-023-04534-8
IF: 3.662
2023-01-26
Journal of Ambient Intelligence and Humanized Computing
Abstract:The constrained application protocol (CoAP) is an application layer protocol in IoT, with underlying support for congestion control mechanism. It minimizes the frequent retransmissions, but does not optimize the throughput or adapt dynamic conditions. However, designing an efficient congestion control mechanism over the IoT poses new challenges because of its resource constraint nature. In this context, this article presents a new Intelligent congestion control algorithm (iCoCoA) for constraint devices, motivated by the success of the deep reinforcement learning in various applications. The iCoCoA learns from the various network features to decide the best Retransmission Timeout to mitigate the congestion in the dynamic environments. It also optimizes the throughput, energy, and unnecessary frequent retransmissions compared with the existing models. iCoCoA is developed and tested on the Cooja simulator and compared it with the standard protocols such as CoAP, CoCoA, and CoCoA+ in continuous and burst traffic conditions. The proposed iCoCoA mitigates congestion, outperforms 4–15% in throughput, 3–10% better packet delivery ratio, and 7–16% energy-efficiency with reduced number of retransmissions.
computer science, information systems,telecommunications, artificial intelligence