Abstract:Next-generation cellular networks strive to offer ubiquitous connectivity, enhanced transmission rates with increased capacity, and superior network coverage. However, they face significant challenges due to the growing demand for multimedia services across diverse devices. Adaptive multimedia streaming services are essential for achieving good viewer Quality of Experience (QoE) levels amidst these challenges. Yet, the existing adaptive video streaming solutions do not consider diverse QoE preferences or are limited to meeting specific QoE objectives. This paper presents FReD-ViQ, a Fuzzy Reinforcement Learning-Driven Adaptive Streaming Solution for Improved Video QoE that combines the strengths of fuzzy logic and advanced Deep Reinforcement Learning (DRL) mechanisms to deliver exceptional, individually tailored user experiences. FReD-ViQ is a sophisticated streaming solution that leverages efficient membership function modelling to achieve a more finely-grained representation of both input and output spaces. This advanced representation is augmented by a set of fuzzy rules that govern the decision-making process. In addition to its fuzzy logic capabilities, FReD-ViQ incorporates a novel DRL algorithm based on Dueling Double Deep Q-Network (Dueling DDQN), noisy networks, and prioritized experience replay (PER) techniques. This innovative fusion enables effective modelling of uncertain network dynamics and high-dimensional state spaces while optimizing exploration-exploitation trade-offs in adaptive streaming environments. Extensive performance evaluations in real-world simulation settings demonstrate that FReD-ViQ effectively surpasses existing solutions across multiple QoE models, yielding average improvements of 23.10% (Linear QoE), 23.97% (Log QoE), and 33.42% (HD QoE).

FReD-ViQ: Fuzzy Reinforcement Learning Driven Adaptive Streaming Solution for Improved Video Quality of Experience

QoE-Aware Dynamic Video Rate Adaptation

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Learning-Based Low-Latency VIoT Video Streaming Against Jamming and Interference

Improving Quality of Experience by Adaptive Video Streaming with Super-Resolution

TCLiVi: Transmission Control in Live Video Streaming Based on Deep Reinforcement Learning

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP

FRAS: Federated Reinforcement Learning empowered Adaptive Point Cloud Video Streaming

QARC: Video Quality Aware Rate Control for Real-Time Video Streaming Based on Deep Reinforcement Learning.

Preference-Aware Dynamic Bitrate Adaptation for Mobile Short-Form Video Feed Streaming

QARC: Video Quality Aware Rate Control for Real-Time Video Streaming via Deep Reinforcement Learning

QoE-Oriented Rate Adaptation for DASH with Enhanced Deep Q-Learning

Adaptive Video Streaming with Automatic Quality-of-Experience Optimization

A Video-Quality Driven Strategy in Short Video Streaming

Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming

Learning-based Joint QoE Optimization for Adaptive Video Streaming based on Smart Edge

QAVA: QoE-Aware Adaptive Video Bitrate Aggregation for HTTP Live Streaming Based on Smart Edge Computing

FedABR: A Personalized Federated Reinforcement Learning Approach for Adaptive Video Streaming.

Multisite gaming streaming optimization over virtualized 5G environment using Deep Reinforcement Learning techniques

Multiuser Video Streaming Rate Adaptation: A Physical Layer Resource-Aware Deep Reinforcement Learning Approach