Abstract:Providing wireless users with high-quality video content has become increasingly important. However, ensuring consistent video quality poses challenges due to variable encoded bitrate caused by dynamic video content and fluctuating channel bitrate caused by wireless fading effects. Suboptimal selection of encoder parameters can lead to video quality loss due to underutilized bandwidth or the introduction of video artifacts due to packet loss. To address this, a real-time deep learning based H.264 controller is proposed. This controller leverages instantaneous channel quality data driven from the physical layer, along with the video chunk, to dynamically estimate the optimal encoder parameters with a negligible delay in real-time. The objective is to maintain an encoded video bitrate slightly below the available channel bitrate. Experimental results, conducted on both QCIF dataset and a diverse selection of random videos from public datasets, validate the effectiveness of the approach. Remarkably, improvements of 10-20 dB in PSNR with repect to the state-of-the-art adaptive bitrate video streaming is achieved, with an average packet drop rate as low as 0.002.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to ensure a consistent and high - quality video experience during real - time video streaming in wireless networks. Specifically, due to the influence of dynamic video content and wireless channel fluctuations, both the encoded bit rate and the channel bit rate will change, which may lead to a decline in video quality or packet loss. To solve these problems, the paper proposes a real - time rate control method based on deep learning to optimize the H.264 encoder parameters, ensuring that the encoded video bit rate is slightly lower than the available channel bit rate, thereby minimizing the packet loss rate while guaranteeing video quality. ### Specific manifestations of the problem 1. **Video bit rate fluctuation**: Factors such as the complexity of video content, color changes, and motion conditions will cause the encoded bit rate to fluctuate. 2. **Channel bit rate fluctuation**: The fading effect of the wireless channel (such as the multipath effect) will cause the channel bit rate to fluctuate. 3. **Improper selection of encoding parameters**: If the encoding parameters are not properly selected, it may lead to under - utilization of bandwidth or loss of video frames, thereby affecting video quality. ### Solution The paper proposes a real - time rate controller (RTRC) based on deep learning. This controller can: - Dynamically estimate the optimal encoding parameters (such as the quantization parameter QP) by using the instantaneous channel quality data and video block information provided by the physical layer. - Ensure that the encoded video bit rate is slightly lower than the available channel bit rate, thereby avoiding bit rate overshoot and packet loss. - Maximize the utilization of available bandwidth and improve the video quality at the receiving end. ### Experimental results The experimental results show that, compared with the existing adaptive bit rate (ABR) video streaming technologies, this method can significantly improve video quality (the PSNR is increased by 10 - 20 dB), and the average packet loss rate is as low as 0.002. These results verify the effectiveness of this method in real - time video streaming in wireless network environments. ### Summary By introducing a real - time rate control method based on deep learning, the paper solves the video quality and packet loss problems in real - time video streaming in wireless networks, providing a more efficient and stable solution.

Deep Learning-Based Real-Time Rate Control for Live Streaming on Wireless Networks

Deep Learning-Based Real-Time Quality Control of Standard Video Compression for Live Streaming

A New Bandwidth Prediction Based Wireless Ad-Hoc Video Communication

Delay-Constrained Rate Control for Real-Time Video Streaming with Bounded Neural Network

Delay-constrained rate control for real-time video streaming over wireless networks

End-to-end Optimized TCP-friendly Rate Control for Real-Time Video Streaming over Wireless Multi-Hop Networks

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Content-Adaptive Coding and Delay-Aware Rate Control for a Multi-Camera Wireless Surveillance Network

Perceptually Adaptive Joint Deringing-Deblocking Filtering for Scalable Video Transmission over Wireless Networks

QARC: Video Quality Aware Rate Control for Real-Time Video Streaming Based on Deep Reinforcement Learning.

Adaptive Rate Control on Wireless Transcoder

An Intelligent Learning Approach to Achieve Near-Second Low-Latency Live Video Streaming under Highly Fluctuating Networks

When Wireless Video Streaming Meets AI: A Deep Learning Approach

Quality-Driven TCP Friendly Rate Control for Real-Time Video Streaming

QARC: Video Quality Aware Rate Control for Real-Time Video Streaming via Deep Reinforcement Learning

Adaptive Video Transmission Control System Based on Reinforcement Learning Approach over Heterogeneous Networks.

Reinforcement Learning-Based Real-Time Video Streaming Control and On-Device Training Research

Quickly Adaptive Real-Time Multimedia Streaming Control Algorithm over Wireless Network

Low-Latency Network-Adaptive Error Control for Interactive Streaming

Joint power allocation and rate control for real-time video transmission over wireless systems

Adaptive QoS Control for Real-Time Video Communication over Wireless Channels