Frame-Level Video Caching and Transmission Scheduling Via Stochastic Learning

Ziwei Zheng,Wei Wang,Hangguan Shan,Zhaoyang Zhang
DOI: https://doi.org/10.1109/globecom46510.2021.9685601
2021-01-01
Abstract:To meet the ever-increasing demand for mobile video services, one of the effective solutions is caching some popular videos in edge nodes. In this paper, we propose an online stochastic learning algorithm with two time scales for joint caching and transmission optimization in the video frame level. To overcome the drift distortion caused by the dependency among video frames, the transmission process is formulated as an infinite horizon Markov decision process (MDP). We derive the equivalent Bellman equation and design the online value iteration algorithm via stochastic approximation for transmission. Due to the lack of the expression between the system performance and the caching policy, we design a gradient-free stochastic optimization algorithm to update the caching policy. Finally, simulation results show that our proposed algorithm achieves better performance than conventional caching algorithms.
What problem does this paper attempt to address?