Abstract:The emerging mobile edge computing (MEC) technology has been recently applied to improve the Quality of Experience (QoE) of network services, such as live video streaming. In this paper, we study an energy-aware adaptive live streaming scheme in wireless edge networks. In particular, we aim to design a joint uplink transmission and edge transcoding algorithm maximizing the video followers’ QoE, while minimizing the energy consumption of the video streamer. We formulate the problem as a Markov decision process (MDP), and propose a deep reinforcement learning (DRL) based framework, named SACCT, to determine the streamer’s encoding bitrate, the uploading power as well as the edge transcoding bitrates and frequency. We decompose the MDP problem into inter-frame and intra-frame problems to address the key design challenges that arise from continuous-discrete hybrid action space, time-varying state and action spaces, and unknown network variation. By doing so, SACCT integrates model-based optimization and model-free DRL to determine the intra-frame continuous resource allocation decisions and the inter-frame discrete bitrate adaptation decisions, respectively. To integrate both the numerical features (e.g., channel gain) and the categorical features (e.g., bitrate), we propose a communication Transformer (CT) as a backbone of SACCT by representing network states as communication tokens and running Transformers to model multi-scale dependencies. Extensive simulations manifest that compared with state-of-the-art approaches, SACCT can provide 128.23% (on average) extra reward. As such, by leveraging joint uplink adaption and edge transcoding, the proposed scheme enables an intelligent wireless network edge with QoE-assured and energy-aware live streaming services.

Neural adaptive IoT streaming analytics with RL-Adapt

Learning-Based Low-Latency VIoT Video Streaming Against Jamming and Interference

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

Neural Adaptive Transport Framework for Internet-scale Interactive Media Streaming Services

Improving Generalization for Neural Adaptive Video Streaming Via Meta Reinforcement Learning

Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming

Multiuser Video Streaming Rate Adaptation: A Physical Layer Resource-Aware Deep Reinforcement Learning Approach

Adaptive Stream Processing on Edge Devices through Active Inference

Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP

Deep Reinforcement Learning-based Rate Adaptation for Adaptive 360-Degree Video Streaming

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

Deep Reinforcement Learning Based Adaptive 360-Degree Video Streaming with Field of View Joint Prediction

Index-aware reinforcement learning for adaptive video streaming at the wireless edge

Intelligent Video Streaming at Network Edge: An Attention-Based Multiagent Reinforcement Learning Solution

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

A Deep Reinforcement Learning Approach for Improving Age of Information in Mission-Critical IoT

Deep Reinforcement Learning With Communication Transformer for Adaptive Live Streaming in Wireless Edge Networks

Imitation Learning for Adaptive Video Streaming with Future Adversarial Information Bottleneck Principle

FairStream: Fair Multimedia Streaming Benchmark for Reinforcement Learning Agents