Markov Decision Policies for Dynamic Video Delivery in Wireless Caching Networks

Minseok Choi,Albert No,Mingyue Ji,Joongheon Kim
DOI: https://doi.org/10.48550/arXiv.1902.10932
2019-02-28
Abstract:This paper proposes a video delivery strategy for dynamic streaming services which maximizes time-average streaming quality under a playback delay constraint in wireless caching networks. The network where popular videos encoded by scalable video coding are already stored in randomly distributed caching nodes is considered under adaptive video streaming concepts, and distance-based interference management is investigated in this paper. In this network model, a streaming user makes delay-constrained decisions depending on stochastic network states: 1) caching node for video delivery, 2) video quality, and 3) the quantity of video chunks to receive. Since wireless link activation for video delivery may introduce delays, different timescales for updating caching node association, video quality adaptation, and chunk amounts are considered. After associating with a caching node for video delivery, the streaming user chooses combinations of quality and chunk amounts in the small timescale. The dynamic decision making process for video quality and chunk amounts at each slot is modeled using Markov decision process, and the caching node decision is made based on the framework of Lyapunov optimization. Our intensive simulations verify that the proposed video delivery algorithm works reliably and also can control the tradeoff between video quality and playback latency.
Networking and Internet Architecture,Distributed, Parallel, and Cluster Computing,Information Theory
What problem does this paper attempt to address?
This paper attempts to solve several key problems in dynamic video transmission services in wireless caching networks. Specifically: 1. **Maximizing the time - average streaming media quality**: Under the premise of meeting the playback delay constraint, optimize the video transmission strategy to improve the overall quality of users' video viewing. 2. **Multi - scale management in the decision - making process**: Considering the delay that may be brought by wireless link activation, the paper proposes update strategies on different time scales, that is, cache node association, video quality adjustment, and the decision on the number of received video blocks are carried out on different time scales respectively. 3. **Integrated decision - making model**: The paper proposes an integrated decision - making model based on the Markov decision process (MDP) and the Lyapunov optimization framework, which is used to determine the cache node selection for video transmission, video quality, and the number of received video blocks. These decisions need to be dynamically adjusted according to the randomly changing network state. Through these methods, the paper aims to provide a reliable video transmission algorithm that can effectively balance the relationship between video quality and playback delay and show good performance in practical applications.