Abstract:Drone-sourced live video analytics has extensive applications across diverse domains. Adaptive video streaming is a pivotal technique in these applications that targets at effectively delivering video content to servers under varying network conditions, enabling complex analytics afterward. However, our thorough data analysis reveals that conventional offline video streaming policies cannot effectively adapt to highly fluctuating drone network environments and dynamic changes in aerial view scenes. This results in suboptimal analytic performance and necessitates online adaptation for policy models. Yet, obtaining ground-truth analytics results directly from drones is infeasible due to their limited capacity. Furthermore, naively streaming original videos to the server for online adaption is greatly challenged by the scarce and dynamic networks, leading to decreased accuracy performance and escalated transmission cost if not properly designed. In this paper, we present OAVS, a novel online learning-enabled adaptive streaming framework for drone-sourced video analytics. To facilitate cost-effective online retraining, we design a hierarchical reinforcement learning approach in which the upper-level module intelligently determines the timing for online retraining, balancing machine-perceived quality of experience (QoE) improvement and transmission cost. Meanwhile, the lower-level module dynamically allocates bitrate to maximize machine-perceived QoE. Extensive experiments based on real-world drone video and aerial network datasets demonstrate that our proposed framework achieves a 17.7% mean accuracy increase, a 37.5% decrease in the mean failure rate of video uploading, and a 5.2% mean latency decrease compared to state-of-the-art solutions.

Batch Adaptative Streaming for Video Analytics

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

Adaptive Streaming Continuous Learning System for Video Analytics

Towards Optimal Real-time Volumetric Video Streaming: A Rolling Optimization and Deep Reinforcement Learning Based Approach

An Intelligent Learning Approach to Achieve Near-Second Low-Latency Live Video Streaming under Highly Fluctuating Networks

Latency Aware Adaptive Video Streaming Using Ensemble Deep Reinforcement Learning.

OAVS: Efficient Online Learning of Streaming Policies for Drone-sourced Live Video Analytics

Optimizing Quality of Experience for Adaptive Bitrate Streaming Via Viewer Interest Inference

Imitation Learning for Adaptive Video Streaming with Future Adversarial Information Bottleneck Principle

Dancing with Shackles, Meet the Challenge of Industrial Adaptive Streaming Via Offline Reinforcement Learning

DeepStream: Bandwidth Efficient Multi-Camera Video Streaming for Deep Learning Analytics

Buffer-Aware Streaming in Small-Scale Wireless Networks: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based Adaptive 360-Degree Video Streaming with Field of View Joint Prediction

CAST: an Intricate-Scene Aware Adaptive Bitrate Approach for Video Streaming Via Parallel Training.

AdaStreamer: Machine-Centric High-Accuracy Multi-Video Analytics with Adaptive Neural Codecs

Optimized Adaptive Streaming Representations based on System Dynamics

Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming

Towards Influence of Chunk Size Variation on Video Streaming in Wireless Networks

Deep Reinforcement Learning-based Rate Adaptation for Adaptive 360-Degree Video Streaming

Adaptive Processing for Video Streaming with Energy Constraint: A Multi-Agent Reinforcement Learning Method