Abstract:Edge computing (EC) platforms, which enable Application Service Providers (ASPs) to deploy applications in close proximity to users, are providing ultra-low latency and location-awareness to a rich portfolio of services. As monetary costs are incurred for renting computing resources on edge servers to enable service provisioning, ASP has to cautiously decide where to deploy the application and how much resources would be needed to deliver satisfactory performance. However, the service provisioning problem exhibits complex correlations with multifarious factors in EC systems, ranging from user behavior to computation offloading, which are difficult to be fully captured by mathematical modeling and also put off traditional machine learning techniques due to the induction of high-dimension state space. The recent success of deep learning (DL) underpins new tools for addressing our problem. While previous works provide valuable insights on applying DL techniques, e.g., distributed DL, deep reinforcement learning (DRL), and multi-agent DL, in EC systems, these techniques cannot solely handle the distributed and heterogeneous nature of EC systems. To address these limitations, we propose a novel framework based on multi-agent DRL, distributed neural network orchestration (N2O), and knowledge distilling. The multi-agent DRL enables edge servers to learn deep neural networks that shelve distinct features learned from local edge sites and hence caters to the heterogeneity of EC systems. N2O coordinates edge servers in a fully distributed manner toward a common goal of maximizing ASP's reward. It requires only local communications during execution and provides provable performance guarantees. The knowledge distilling is further utilized to distill the N2O policy for reducing the communication overhead and stabilizing the decision-making. We also carry out systematic experiments to show the advantages of our method over stat--of-the-art alternatives.

Fair DNN Model Selection in Edge AI Via A Cooperative Game Approach

Load Balancing for Distributed Intelligent Edge Computing: A State-Based Game Approach.

CoEdge: Cooperative DNN Inference With Adaptive Workload Partitioning Over Heterogeneous Edge Devices

Accelerating Deep Neural Network Tasks Through Edge-Device Adaptive Inference

CoMS: Collaborative DNN Model Selection for Heterogeneous Edge Computing Systems

Joint Optimization of Device Placement and Model Partitioning for Cooperative DNN Inference in Heterogeneous Edge Computing

An Online Approach for DNN Model Caching and Processor Allocation in Edge Computing

A Game-Theoretical Approach for User Allocation in Edge Computing Environment

Edge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge Synergy

Dynamic DNN Model Selection and Inference off Loading for Video Analytics with Edge-Cloud Collaboration

Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System.

EdgeAdaptor: Online Configuration Adaption, Model Selection and Resource Provisioning for Edge DNN Inference Serving at Scale

NeuE: Automated Neural Network Ensembles for Edge Intelligence

Seek Common While Shelving Differences: Orchestrating Deep Neural Networks for Edge Service Provisioning

Online Optimization of DNN Inference Network Utility in Collaborative Edge Computing

Edge AI as a Service with Coordinated Deep Neural Networks

Implementation of Big AI Models for Wireless Networks with Collaborative Edge Computing

Improving QoE of Deep Neural Network Inference on Edge Devices: A Bandit Approach

Incentivizing Edge AI with Accuracy Preserving via Online Randomized Auctions

Edge-Cloud Cooperation for DNN Inference Via Reinforcement Learning and Supervised Learning

Modeling of Deep Neural Network (DNN) Placement and Inference in Edge Computing