Abstract:Edge computing offers an additional layer of compute infrastructure closer to the data source before raw data from privacy-sensitive and performance-critical applications is transferred to a cloud data center. Deep Neural Networks (DNNs) are one class of applications that are reported to benefit from collaboratively computing between the edge and the cloud. A DNN is partitioned such that specific layers of the DNN are deployed onto the edge and the cloud to meet performance and privacy objectives. However, there is limited understanding of: (a) whether and how evolving operational conditions (increased CPU and memory utilization at the edge or reduced data transfer rates between the edge and the cloud) affect the performance of already deployed DNNs, and (b) whether a new partition configuration is required to maximize performance. A DNN that adapts to changing operational conditions is referred to as an 'adaptive DNN'. This paper investigates whether there is a case for adaptive DNNs in edge computing by considering three questions: (i) Are DNNs sensitive to operational conditions? (ii) How sensitive are DNNs to operational conditions? (iii) Do individual or a combination of operational conditions equally affect DNNs? (iv) Is DNN partitioning sensitive to hardware architectures on the cloud/edge? The exploration is carried out in the context of 8 pre-trained DNN models and the results presented are from analyzing nearly 8 million data points. The results highlight that network conditions affects DNN performance more than CPU or memory related operational conditions. Repartitioning is noted to provide a performance gain in a number of cases, but a specific trend was not noted in relation to its correlation to the underlying hardware architecture. Nonetheless, the need for adaptive DNNs is confirmed.

LSTM Network-Based Adaptation Approach for Dynamic Integration in Intelligent End-Edge-Cloud Systems

Microservice Auto-Scaling Algorithm Based on Workload Prediction in Cloud-Edge Collaboration Environment

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

Collaborative Cloud and Edge Computing for Latency Minimization

ECLM: Efficient Edge-Cloud Collaborative Learning with Continuous Environment Adaptation

Enhancing QoS with LSTM-Based Prediction for Congestion-Aware Aggregation Scheduling in Edge Federated Learning

Reinforcement Learning-based Mobile Edge Computing and Transmission Scheduling for Video Surveillance

Task Offloading based on Deep Reinforcement Learning with LSTM for Mobile Edge Computing

Computational Offloading in Semantic-Aware Cloud-Edge-End Collaborative Networks

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments

Edge artificial intelligence-based affinity task offloading under resource adjustment in a 5G network

Cloud-Edge Learning for Adaptive Video Streaming in B5G Internet-of-Thing Systems

EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive Layer Tuning and Voting

OsmoticGate: Adaptive Edge-Based Real-Time Video Analytics for the Internet of Things

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing

Task Offloading Based on LSTM Prediction and Deep Reinforcement Learning for Efficient Edge Computing in IoT

Design and Evaluation of a Prediction-Based Dynamic Edge Computing System

Fine-grained resource adjustment of edge server in cloud-edge collaborative environment

Dynamic adaptive workload offloading strategy in mobile edge computing networks

Adaptive Scheduling Based on Intelligent Agents in Edge-Cloud Computing Environments

A Case For Adaptive Deep Neural Networks in Edge Computing