Infinite Horizon Optimal Impulsive Control Theory with Application to Internet Congestion Control

Konstantin Avrachenkov,Oussama Habachi,Alexei Piunovskiy,Zhang Yi
DOI: https://doi.org/10.48550/arXiv.1311.7093
2013-11-27
Networking and Internet Architecture
Abstract:We develop Bellman equation based approach for infinite time horizon optimal impulsive control problems. Both discounted and time average criteria are considered. We establish very general and at the same time natural conditions under which a canonical control triplet produces an optimal feedback policy. Then, we apply our general results for Internet congestion control providing a convenient setting for the design of active queue management algorithms. In particular, our general theoretical results suggest a simple threshold-based active queue management scheme which takes into account the main parameters of the transmission control protocol.
What problem does this paper attempt to address?