Deadline-Constrained Multi-Agent Collaborative Transmission for Delay-Sensitive Applications
Kang Liu,Wei Quan,Nan Cheng,Xue Zhang,Liang Guo,Deyun Gao,Hongke Zhang
DOI: https://doi.org/10.1109/tccn.2023.3288133
IF: 6.359
2023-01-01
IEEE Transactions on Cognitive Communications and Networking
Abstract:Delay-sensitive applications impose the strict deadline-constrained latency requirement for end-to-end transmission. However, due to the high dynamics of link status and the limited network resources, it is still challenging to ensure deterministic end-to-end latency for deadline-constrained flows. To this end, we propose a deadline-constrained multi-agent collaborative transmission mechanism (DMCT). Specially, DMCT is featured by combining dynamic routing and packet active dropping control to avoid additional end-to-end latency. Firstly, we design a specific packet structure to detect network status and aware the deadline of each flow. Secondly, to enhance the precision of routing decision, we further formulate deadline-constrained flow scheduling as a joint minimization problem that considers the deadline of flows, queuing delay, and network status. Then, we propose a multi-agent collaborative routing algorithm to find the solution to the joint minimization problem. Finally, we propose a local-agent deadline-constrained active queue management algorithm for packet active dropping control and routing adjustment. Simulation results show that the proposed DMCT outperforms the state-of-the-art solutions, e.g., graph convolutional network-based deep reinforcement learning (GCNL) and delay-based shortest path first (D-SPF), in terms of one-way round-trip time, drop rate, and queue length.
telecommunications