A Receiver-Driven Named Data Networking (NDN) Congestion Control Method Based on Reinforcement Learning

Ruijuan Zheng,Bohan Zhang,Xuhui Zhao,Lin Wang,Qingtao Wu
DOI: https://doi.org/10.3390/electronics13234609
IF: 2.9
2024-01-01
Electronics
Abstract:Named data networking (NDN) is a novel networking paradigm characterized by in-network caching, receiver-driven communication, and multi-source, multi-path data retrieval, which poses new challenges for congestion control. Existing work has largely focused on receiver-driven mechanisms. Due to delays in obtaining network control information (timeouts, NACKs) within NDN, consumers are unable to access the network congestion status from this information in a timely manner. To address the issues above, this paper combines the Q-learning algorithm with the NDN architecture, proposing Q-NDN. In Q-NDN, consumers can dynamically adjust the congestion window (cwnd) through the real-time monitoring of network status, leveraging the Q-learning algorithm, achieving automatic congestion control for the NDN architecture. Additionally, this paper introduces content popularity-based traffic scheduling for multi-user scenarioswhich adjusts the transmission rates of content with different popularity levels to maintain a dynamic balance in the network. The experimental results show that Q-NDN can converge quickly, make full use of bandwidth resources, and keep the packet loss rate to 0 in the basic network topology. In competing network topologies, Q-NDN can rapidly address conflict issues, efficiently utilize bandwidth resources, and maintain a relatively low packet loss rate.
What problem does this paper attempt to address?