Abstract:Nowadays, the internet is rapidly evolving towards the future of the Internet of Things (IoT), where billions or even trillions of edge devices may be interconnected. The proliferation of network cameras and the advancement of IoT technologies have provided broader opportunities for data collection and utilization. In the past, the massive real-time videos generated by network cameras were mostly transmitted over the network to the cloud for analysis. However, due to network speed limitations, the latency incurred by uploading all videos to the cloud makes it difficult to meet the real-time requirements of video analysis. While edge computing significantly reduces latency, the computational capabilities of edge devices are limited, making it difficult to handle large amounts of real-time video data. In this paper, we introduce a real-time video processing framework called DeepVA, which utilizes cloud-edge collaboration technology to reduce latency in real-time video processing and enhance the accuracy of analysis. The DeepVA framework incorporates the DRLVA video frame distribution algorithm based on deep reinforcement learning, which dynamically determines whether to distribute video frames for processing at the cloud or edge. To evaluate the performance of the proposed DRLVA algorithm, we first verify that it is superior to several other deep reinforcement learning-based distribution algorithms on the Gym environment. We also evaluate the performance of DeepVA on the MOT2015 dataset, MOTSynth dataset, and real campus surveillance videos. The experiments show that our DeepVA outperforms both cloud-only and edge-only solutions in terms of reducing latency and improving accuracy.

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

RECL: Responsive Resource-Efficient Continuous Learning for Video Analytics

Real-time Surveillance Video Salient Object Detection Using Collaborative Cloud-Edge Deep Reinforcement Learning.

EdgeVision: Towards Collaborative Video Analytics on Distributed Edges for Performance Maximization

Adaptive Processing for Video Streaming with Energy Constraint: A Multi-Agent Reinforcement Learning Method

Reinforcement Learning-based Mobile Edge Computing and Transmission Scheduling for Video Surveillance

Intelligent Video Streaming at Network Edge: An Attention-Based Multiagent Reinforcement Learning Solution

Edge Computing Enabled Real-Time Video Analysis via Adaptive Spatial-Temporal Semantic Filtering

OsmoticGate: Adaptive Edge-Based Real-Time Video Analytics for the Internet of Things

Dynamic DNN Model Selection and Inference off Loading for Video Analytics with Edge-Cloud Collaboration

Streaming Video Analytics On The Edge With Asynchronous Cloud Support

Multi-Modal Deep Reinforcement Learning for Edge-Assisted Video Analytics.

Video Surveillance on Mobile Edge Networks—A Reinforcement-Learning-Based Approach

SurveilEdge: Real-time Video Query Based on Collaborative Cloud-Edge Deep Learning.

A Distributed Video Analytics Architecture Based on Edge-Computing and Federated Learning

Enabling Adaptive Deep Neural Networks for Video Surveillance in Distributed Edge Clouds

Edge Computing Technologies for Streaming Video Analytics

Collaborative Task Offloading Based on Deep Reinforcement Learning in Heterogeneous Edge Networks

A DRL-Based Real-Time Video Processing Framework in Cloud-Edge Systems

Adaptive Streaming Continuous Learning System for Video Analytics