Abstract:Multimedia content delivery over the Internet is predominantly using the Hypertext Transfer Protocol (HTTP) as its primary protocol and multiple proprietary solutions exits. The MPEG standard Dynamic Adaptive Streaming over HTTP (DASH) provides an interoperable solution and in recent years various adaptation logics/algorithms have been proposed. However, to the best of our knowledge, there is no comprehensive evaluation of the various logics/algorithms. Therefore, this paper provides a comprehensive evaluation of ten different adaptation logics/algorithms, which have been proposed in the past years. The evaluation is done both objectively and subjectively. The former is using a predefined bandwidth trajectory within a controlled environment and the latter is done in a real-world environment adopting crowdsourcing. The results shall provide insights about which strategy can be adopted in actual deployment scenarios. Additionally, the evaluation methodology described in this paper can be used to evaluate any other/new adaptation logic and to compare it directly with the results reported here.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the comprehensive performance evaluation of different adaptation logics/algorithms in the dynamic adaptive streaming transmission system. Specifically, the paper aims to comprehensively evaluate ten different adaptation logics/algorithms proposed in the past few years from both objective and subjective aspects. This is not only to provide insights into which strategy can be adopted in actual deployment scenarios, but also to establish a methodology that can be used to evaluate any other new adaptation logic, so that new research can be directly compared with the results reported in this paper. ### Background of the Paper With the popularization of Internet multimedia content, the HTTP protocol has become the main transmission protocol. DASH (Dynamic Adaptive Streaming over HTTP) in the MPEG standard provides an interoperable solution, but currently there is a lack of comprehensive evaluation of various adaptation logics/algorithms. The paper points out that although some studies have evaluated the adaptation logic under specific conditions, none of them can provide a comprehensive and easy - to - compare evaluation method. ### Solution The paper proposes a comprehensive evaluation framework, which includes: - **Objective Evaluation**: Evaluate the performance of the adaptation logic using predefined bandwidth trajectories in a controlled environment. Evaluation metrics include bandwidth utilization, stability, average bit rate, buffer level, startup time, and the number of buffer underruns/stalls. - **Subjective Evaluation**: Collect data on Quality of Experience (QoE) through crowdsourcing in the real - world environment. Participants watch videos through the network platform and score according to their experience. ### Evaluation Methods - **Objective Evaluation Method**: Use Unix programs TC and netEM to simulate the bandwidth and delay between the server and the client. During the evaluation process, multiple key indicators are recorded, such as the observed bit rate, the selected quality representation, the buffer level, etc. - **Subjective Evaluation Method**: Recruit participants in the European region through the Microworker platform. Each participant needs to complete a short questionnaire, watch video clips streamed by a JavaScript - based DASH client, and then score according to their experience. ### Evaluation Results - **Objective Results**: Show the performance differences of different adaptation logics under 2 - second and 10 - second segment lengths, especially in terms of bandwidth adaptation, buffer level, etc. - **Subjective Results**: Evaluate the actual Quality of Experience of different adaptation logics through users' ratings. ### Conclusion By comprehensively evaluating ten different adaptation logics, the paper provides insights into which strategies are better in actual deployment and proposes an evaluation methodology that can be used for future research. This not only helps to improve the existing adaptation logics, but also provides a reference standard for the development of new adaptation logics.

Which Adaptation Logic? An Objective and Subjective Performance Evaluation of HTTP-based Adaptive Media Streaming Systems

Evaluation of the Performance of Adaptive HTTP Streaming Systems

Evaluation of HTTP/DASH Adaptation Algorithms on Vehicular Networks

Playback Continuity and Video Quality Driven Optimisation for Dynamic Adaptive Streaming over HTTP Clients over Wireless Networks

Mdash: A Markov Decision-Based Rate Adaptation Approach for Dynamic HTTP Streaming

A Fairness-Aware Smooth Rate Adaptation Approach for Dynamic Http Streaming

Towards Better Quality of Experience in HTTP Adaptive Streaming

An adaptive video streaming control system: modeling, validation, and performance evaluation

Optimized Adaptive Streaming Representations based on System Dynamics

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

A Novel Play-out Algorithm for HTTP Adaptive Streaming

Poor Video Streaming Performance Explained (and Fixed)

MEDUSA: A Dynamic Codec Switching Approach in HTTP Adaptive Streaming

An Adaptative Bitrate Algorithm for DASH

A Quality-driven Bit Rate Adaptation Method for Dynamic Adaptive Streaming over HTTP

Dynamic Threshold Based Rate Adaptation For Http Live Streaming

Low-Delay Adaptive Video Streaming Based on Short-Term TCP Throughput Prediction

Delving into Internet Streaming Media Delivery

A Control-Theoretic Approach to Rate Adaption for DASH over Multiple Content Distribution Servers

Towards Machine Learning-Based Optimal HAS

Two-State Buffer Driven Rate Adaptation Strategy for Improving Video QoE over HTTP.