Abstract:Because of reinforcement learning's (RL) ability to automatically create more adaptive controlling logics beyond the hand-crafted heuristics, numerous effort has been made to apply RL to congestion control (CC) design for real time video communication (RTC) applications and has successfully shown promising benefits over the rule-based RTC CCs. Online reinforcement learning is often adopted to train the RL models so the models can directly adapt to real network environments. However, its trail-and-error manner can also cause catastrophic degradation of the quality of experience (QoE) of RTC application at run time. Thus, safeguard strategies such as falling back to hand-crafted heuristics can be used to run along with RL models to guarantee the actions explored in the training sensible, despite that these safeguard strategies interrupt the learning process and make it more challenging to discover optimal RL policies. The recent emergence of loss-tolerant neural video codecs (NVC) naturally provides a layer of protection for the online learning of RL-based congestion control because of its resilience to packet losses, but such packet loss resilience have not been fully exploited in prior works yet. In this paper, we present a reinforcement learning (RL) based congestion control which can be aware of and takes advantage of packet loss tolerance characteristic of NVCs via reward in online RL learning. Through extensive evaluation on various videos and network traces in a simulated environment, we demonstrate that our NVC-aware CC running with the loss-tolerant NVC reduces the training time by 41\% compared to other prior RL-based CCs. It also boosts the mean video quality by 0.3 to 1.6dB, lower the tail frame delay by 3 to 200ms, and reduces the video stalls by 20\% to 77\% in comparison with other baseline RTC CCs.

Intelligent Video Ingestion for Real-time Traffic Monitoring

&Lt;title>automatic Traffic Real-Time Analysis System Based on Video</title>

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

QARC: Video Quality Aware Rate Control for Real-Time Video Streaming Based on Deep Reinforcement Learning.

QARC: Video Quality Aware Rate Control for Real-Time Video Streaming via Deep Reinforcement Learning

Quality-Driven Adaptive Video Streaming for Cognitive VANETs

Receiver Sender Packet Transmission Packet Reception Video Decoder Video Quality Prediction Network Video Quality Reinforcement Learning Video Streaming Session Noise Filter Video Encoder Present Video Frames Video Quality Predicted Bitrate Selection QARC Future Time Feedback Message

SMDP-based Resource Allocation for Video Streaming in Cognitive Vehicular Networks.

Reinforcement Learning-based Mobile Edge Computing and Transmission Scheduling for Video Surveillance

Generalizing Rate Control Strategies for Realtime Video Streaming via Learning from Deep Learning.

Improving Quality of Experience by Adaptive Video Streaming with Super-Resolution

Delay-Constrained Rate Control for Real-Time Video Streaming with Bounded Neural Network

A Deep Reinforcement Learning Approach for Ramp Metering Based on Traffic Video Data

Neural Adaptive Transport Framework for Internet-scale Interactive Media Streaming Services

Adaptive Streaming Continuous Learning System for Video Analytics

Deep Learning-Based Real-Time Quality Control of Standard Video Compression for Live Streaming

Region-of-Interest Based Coding Scheme for Live Videos

Loss-tolerant neural video codec aware congestion control for real time video communication

Deep Learning-Based Real-Time Rate Control for Live Streaming on Wireless Networks

Adaptive Network Configuration for Efficient and Accurate Neural Video Inference

PACC: Perception Aware Congestion Control for Real-time Communication