BOLA360: Near-optimal View and Bitrate Adaptation for 360-degree Video Streaming

Ali Zeynali,Mahsa Sahebdel,Mohammad Hajiesmaili,Ramesh K. Sitaraman

2024-10-01

Abstract:Recent advances in omnidirectional cameras and AR/VR headsets have spurred the adoption of 360-degree videos that are widely believed to be the future of online video streaming. 360-degree videos allow users to wear a head-mounted display (HMD) and experience the video as if they are physically present in the scene. Streaming high-quality 360-degree videos at scale is an unsolved problem that is more challenging than traditional (2D) video delivery. The data rate required to stream 360-degree videos is an order of magnitude more than traditional videos. Further, the penalty for rebuffering events where the video freezes or displays a blank screen is more severe as it may cause cybersickness. We propose an online adaptive bitrate (ABR) algorithm for 360-degree videos called BOLA360 that runs inside the client's video player and orchestrates the download of video segments from the server so as to maximize the quality-of-experience (QoE) of the user. BOLA360 conserves bandwidth by downloading only those video segments that are likely to fall within the field-of-view (FOV) of the user. In addition, BOLA360 continually adapts the bitrate of the downloaded video segments so as to enable a smooth playback without rebuffering. We prove that BOLA360 is near-optimal with respect to an optimal offline algorithm that maximizes QoE. Further, we evaluate BOLA360 on a wide range of network and user head movement profiles and show that it provides $13.6\%$ to $372.5\%$ more QoE than state-of-the-art algorithms. While ABR algorithms for traditional (2D) videos have been well-studied over the last decade, our work is the first ABR algorithm for 360-degree videos with both theoretical and empirical guarantees on its performance.

Multimedia

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to effectively manage bandwidth resources while ensuring the quality of experience (QoE) and avoiding the occurrence of rebuffering when distributing high - quality 360 - degree video streams on a large scale. Specifically, the transmission of 360 - degree video streams faces two main challenges:

1. **Huge amount of data**: The data rate of 360 - degree videos is an order of magnitude higher than that of traditional 2D videos, which makes the transmission of 360 - degree videos require more bandwidth resources. For example, a 360 - degree video stream providing 4K resolution has a data rate as high as 200 Mbps, while the data rate of a traditional 4K video stream is about 25 Mbps.

2. **High requirements for user experience**: The user experience of 360 - degree videos is very sensitive to latency. When the user's field of view (FOV) changes, the video segments within the new field of view must be rendered within a few milliseconds; otherwise, rebuffering will occur, that is, the video pauses or a blank screen is displayed, which will seriously affect the user experience and even lead to cybersickness.

To solve these problems, the paper proposes an online adaptive bitrate (ABR) algorithm - BOLA360. BOLA360 optimizes the transmission of 360 - degree video streams in the following ways:

- **Predicting the user's field of view**: BOLA360 predicts the video segments (tiles) that the user is likely to watch and only downloads these segments, thus saving bandwidth resources.
- **Dynamically adjusting the bitrate**: BOLA360 dynamically adjusts the bitrate of each video segment according to the current buffer state and available bandwidth to ensure smooth playback and avoid rebuffering.

The main contributions of the paper include:

1. **Problem modeling**: The QoE optimization problem of 360 - degree video streams is modeled as an online ABR problem (ABR360), and QoE is defined as the weighted sum of two parts: one is the utility value related to video quality, and the other is the smoothness related to continuous playback.
2. **Offline optimal solution**: An offline optimal solution is proposed to evaluate the maximum QoE upper limit of any online algorithm.
3. **Approximately optimal algorithm**: The BOLA360 algorithm is developed, which can find an approximately optimal solution without knowing future inputs and proves that its performance is close to the offline optimal solution.
4. **Performance evaluation**: Through simulation experiments, BOLA360 is compared with the existing state - of - the - art algorithms, and the results show that BOLA360 can significantly improve QoE under various network conditions and user head movement patterns.

In conclusion, through proposing the BOLA360 algorithm, this paper effectively solves the bandwidth management and user experience optimization problems in the transmission of 360 - degree video streams.