Abstract:Deep reinforcement learning (DRL) demonstrates its promising potential in the realm of adaptive video streaming and has recently received increasing attention. However, existing DRL-based methods for adaptive video streaming use only application (APP) layer information, adopt heuristic training methods, and train generalized neural networks with pre-collected data. This paper aims to boost the quality of experience (QoE) of adaptive wireless video streaming by using lower-layer information, deriving a rigorous training method, and adopting online tuning with real-time data. First, we formulate a more comprehensive and accurate adaptive wireless video streaming problem as an infinite stage discounted Markov decision process (MDP) problem by additionally incorporating past and lower-layer information, allowing a flexible tradeoff between QoE and costs for obtaining system information and solving the problem. In the offline scenario (only with pre-collected data), we propose an enhanced asynchronous advantage actor-critic (eA3C) method by jointly optimizing the parameters of parameterized policy and value function. Specifically, we build an eA3C network consisting of a policy network and a value network that can utilize cross-layer, past, and current information and jointly train the eA3C network using pre-collected samples. In the online scenario (with additional real-time data), we propose two continual learning-based online tuning methods for designing better policies for a specific user with different QoE and training time tradeoffs. Finally, experimental results show that the proposed offline policy can improve the QoE by 6.8~14.4% compared to the state-of-arts in the offline scenario, and the proposed online policies can further achieve 6~28% gains in QoE over the proposed offline policy in the online scenario.

OAVS: Efficient Online Learning of Streaming Policies for Drone-sourced Live Video Analytics

An Intelligent Learning Approach to Achieve Near-Second Low-Latency Live Video Streaming under Highly Fluctuating Networks

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Enhancing Neural Adaptive Wireless Video Streaming via Lower-Layer Information Exposure and Online Tuning

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

Sensor-Augmented Neural Adaptive Bitrate Video Streaming on UAVs

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

Off-Policy - Soft Actor-Critic-based Adaptive Streaming for 360-degree Video in Heterogeneous Wireless Networks.

Towards Optimal Real-time Volumetric Video Streaming: A Rolling Optimization and Deep Reinforcement Learning Based Approach

Energy-Efficient Video Streaming in UAV-Enabled Wireless Networks: A Safe-DQN Approach

Dancing with Shackles, Meet the Challenge of Industrial Adaptive Streaming Via Offline Reinforcement Learning

Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming

Batch Adaptative Streaming for Video Analytics

Deep Reinforcement Learning Based Adaptive 360-Degree Video Streaming with Field of View Joint Prediction

ILCAS: Imitation Learning-Based Configuration-Adaptive Streaming for Live Video Analytics with Cross-Camera Collaboration

Adaptive Streaming Continuous Learning System for Video Analytics

Energy Efficiency Maximization for Secure Live Video Streaming in UAV Wireless Networks

FHVAC: Feature-level Hybrid Video Adaptive Configuration for Machine-centric Live Streaming

Latency Aware Adaptive Video Streaming Using Ensemble Deep Reinforcement Learning.

Neural Adaptive Video Streaming with OfflineReinforcement Learning

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming