Abstract:The rapid progress in edge computing (EC) and 5G wireless communication technology has opened up novel opportunities for intelligent applications driven by Deep Neural Networks (DNNs). In particular, machine vision tasks are widely used in mobile/edge computing scenarios. However, the realtime and dense data transmission involved in vision inference services impose significant communication burdens on wireless networks. Thus, this paper investigates the general vision services strategy with cognitive computing network and proposes a communication-efficient edge inference deployment architecture for vision analytic tasks. In this framework, users dynamically perceive the inference data in local, and then compress and offload them to the edge server to perform inference. Specifically, we present a collaborative optimization model of compression ratio and network bandwidth to generate the reliable compression offloading and resource allocation scheme. For this model, the offloading scheme carefully considers the constraints imposed by delay and resources and maximizes the success probability of the vision inference tasks. To improve the vision inference performance in the edge network, we further propose a flexible data compression algorithm for images or video frames, which can preserve the more important visual information under a fixed compression rate to reduce the inference accuracy loss from compression. This algorithm first perceives the importance of visual information at different pixel positions, and then compresses different visual regions to varying degrees according to their importance, enabling content-aware adaptive vision data coding. Experimental results show that our proposed offloading model and compression strategy outperform other algorithms, achieving significant communication improvements and performance gains.

Multi-stream Adaptive Offloading of Joint Compressed Video Streams, Feature Streams, and Semantic Streams in Edge Computing Systems.

An Energy-efficient Computing Offloading Framework for Blockchain-enabled Video Streaming Systems

Adaptive Configuration Selection and Bandwidth Allocation for Edge-Based Video Analytics

Adaptive Compression Offloading and Resource Allocation for Edge Vision Computing

DCVP: Distributed Collaborative Video Stream Processing in Edge Computing

Adaptive Processing for Video Streaming with Energy Constraint: A Multi-Agent Reinforcement Learning Method

Joint Configuration Adaptation and Bandwidth Allocation for Edge-based Real-time Video Analytics

Delay-Optimal Computation Offloading in Large-Scale Multi-Access Edge Computing Using Mean Field Game

Machine Learning Assisted Video Stream Offloading for 5G MBMS Mobile Edge Computing

Offloading Revenue Maximization in Multi-UAV-Assisted Mobile Edge Computing for Video Stream

OsmoticGate: Adaptive Edge-Based Real-Time Video Analytics for the Internet of Things

SplitStream: Distributed and workload-adaptive video analytics at the edge

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Joint Video Transcoding and Representation Selection for Edge-Assisted Multi-party Video Conferencing

Online Multi-Task Offloading for Semantic-Aware Edge Computing Systems

AMIS: Edge Computing Based Adaptive Mobile Video Streaming

A Joint Online Transcoding and Delivery Approach for Dynamic Adaptive Streaming

Edge Computing Enabled Real-Time Video Analysis via Adaptive Spatial-Temporal Semantic Filtering

Intelligent resource allocation scheme for cloud-edge-end framework aided multi-source data stream

Collaborative Multi-bitrate Video Caching and Processing in Mobile-Edge Computing Networks

Joint online transcoding and geo-distributed delivery for dynamic adaptive streaming