Abstract:Edge computing offers an additional layer of compute infrastructure closer to the data source before raw data from privacy-sensitive and performance-critical applications is transferred to a cloud data center. Deep Neural Networks (DNNs) are one class of applications that are reported to benefit from collaboratively computing between the edge and the cloud. A DNN is partitioned such that specific layers of the DNN are deployed onto the edge and the cloud to meet performance and privacy objectives. However, there is limited understanding of: (a) whether and how evolving operational conditions (increased CPU and memory utilization at the edge or reduced data transfer rates between the edge and the cloud) affect the performance of already deployed DNNs, and (b) whether a new partition configuration is required to maximize performance. A DNN that adapts to changing operational conditions is referred to as an 'adaptive DNN'. This paper investigates whether there is a case for adaptive DNNs in edge computing by considering three questions: (i) Are DNNs sensitive to operational conditions? (ii) How sensitive are DNNs to operational conditions? (iii) Do individual or a combination of operational conditions equally affect DNNs? (iv) Is DNN partitioning sensitive to hardware architectures on the cloud/edge? The exploration is carried out in the context of 8 pre-trained DNN models and the results presented are from analyzing nearly 8 million data points. The results highlight that network conditions affects DNN performance more than CPU or memory related operational conditions. Repartitioning is noted to provide a performance gain in a number of cases, but a specific trend was not noted in relation to its correlation to the underlying hardware architecture. Nonetheless, the need for adaptive DNNs is confirmed.

AI-Driven Automation for Optimal Edge Cluster Network Management

AI-oriented Workload Allocation for Cloud-Edge Computing.

Edge Network Optimization Based on AI Techniques: A Survey

AI Management Platform with Embedded Edge Cluster

Next-Generation Edge Computing: Leveraging Ai-Driven Iot For Autonomous, Real-Time Decision Making And Cyber security

Slicing-Based Artificial Intelligence Service Provisioning on the Network Edge: Balancing AI Service Performance and Resource Consumption of Data Management

Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing

Distributed AI in Zero-touch Provisioning for Edge Networks: Challenges and Research Directions

Communication-efficient distributed AI strategies for the IoT edge

Intelligent Task Dispatching and Scheduling Using a Deep Q-Network in a Cluster Edge Computing System

Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing

Artificial Intelligence-Assisted Edge Computing for Wide Area Monitoring

Artificial Intelligence-Driven Mechanism for Edge Computing-Based Industrial Applications

Edge Computing with Artificial Intelligence: A Machine Learning Perspective

Slicing-Based AI Service Provisioning on Network Edge

Joint Optimization With DNN Partitioning and Resource Allocation in Mobile Edge Computing

Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence

AI-Enhanced Offloading in Edge Computing: When Machine Learning Meets Industrial IoT

A Case For Adaptive Deep Neural Networks in Edge Computing

Research on collaborative edge network service migration strategy based on crowd clustering

Partitioning and Deployment of Deep Neural Networks on Edge Clusters