Abstract:The development of AIoT (Artificial Intelligence of Things) and communication technologies has recently brought with it many promising applications. Intelligent surveillance is one of the new models of applications that synthesizes both technologies of IoTs and the object recognition method of artificial intelligence. However, this system suffers from the heavy computation load problem, but the processing devices are generally lightweight with only limited memory and computation power. In this paper, we propose a cooperative image object recognition framework to integrate the process of AIoT devices into the edge computing environment to overcome this problem. The proposed scheme offloads some captured surveillance video frames to nearby GPU equipped edge servers and then integrates the returned results to enhance the overall recognition accuracy of the surveillance system. We also formulate the AIoT Task Offloading scheduling to a mathematical programming Problem (named ATOP) and prove it to be an NP-complete problem. A heuristic Particle Swarm Optimization algorithm is also proposed to determine near optimal offloading scheduling for the ATOP such that the overall object recognition precision is maximized. Although the object recognition precision is enhanced, there still remains a gap to the ground truth, and the cumulative gap might cause significant errors as times goes by. In this research, we also develop a mechanism to help the designer to automatically diagnose when the cumulative errors become significant. Simulation results demonstrate that the proposed framework is feasible and the proposed Particle Swarm Optimization algorithm for the ATOP outperforms the greedy approach and the genetic algorithm. The simulation results also show that the abnormal data diagnosis mechanism can figure out when the cumulative errors happen using a real-world human-flow counting data set.

Context-Aware Offloading for Edge-Assisted On-Device Video Analytics Through Online Learning Approach

Edge Computing Enabled Real-Time Video Analysis via Adaptive Spatial-Temporal Semantic Filtering

EdgeBrain: A Game Based Collaborative Computational Task Offloading Framework for Edge Video Analytics

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

OsmoticGate: Adaptive Edge-Based Real-Time Video Analytics for the Internet of Things

Edge-assisted Online On-device Object Detection for Real-time Video Analytics.

A Novel Adaptive Computation Offloading Strategy for Collaborative DNN Inference over Edge Devices.

A cooperative image object recognition framework and task offloading optimization in edge computing

Deep Learning on Mobile Devices Through Neural Processing Units and Edge Computing

ROIAdaptor: Adaptive Task Offloading of ROI-Encoded Videos for Edge Video Analytics

Dynamic DNN Model Selection and Inference off Loading for Video Analytics with Edge-Cloud Collaboration

Optimizing Edge Offloading Decisions for Object Detection

A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing

Real-Time Offloading for Dependent and Parallel Tasks in Cloud-Edge Environments Using Deep Reinforcement Learning

Joint Optimization of Task Offloading and Resource Allocation for Edge Video Analytics.

Deep Learning-Assisted Online Task Offloading for Latency Minimization in Heterogeneous Mobile Edge

Deep reinforcement learning-based online task offloading in mobile edge computing networks

Online Learning for Orchestration of Inference in Multi-User End-Edge-Cloud Networks

CooCo: A Collaborative Offloading and Resource Configuration Algorithm in Edge Networks

Edge Intelligence: A Computational Task Offloading Scheme for Dependent IoT Application

ATO-EDGE: Adaptive Task Offloading for Deep Learning in Resource-Constrained Edge Computing Systems.