Abstract:Edge computing (EC) platforms, which enable Application Service Providers (ASPs) to deploy applications in close proximity to users, are providing ultra-low latency and location-awareness to a rich portfolio of services. As monetary costs are incurred for renting computing resources on edge servers to enable service provisioning, ASP has to cautiously decide where to deploy the application and how much resources would be needed to deliver satisfactory performance. However, the service provisioning problem exhibits complex correlations with multifarious factors in EC systems, ranging from user behavior to computation offloading, which are difficult to be fully captured by mathematical modeling and also put off traditional machine learning techniques due to the induction of high-dimension state space. The recent success of deep learning (DL) underpins new tools for addressing our problem. While previous works provide valuable insights on applying DL techniques, e.g., distributed DL, deep reinforcement learning (DRL), and multi-agent DL, in EC systems, these techniques cannot solely handle the distributed and heterogeneous nature of EC systems. To address these limitations, we propose a novel framework based on multi-agent DRL, distributed neural network orchestration (N2O), and knowledge distilling. The multi-agent DRL enables edge servers to learn deep neural networks that shelve distinct features learned from local edge sites and hence caters to the heterogeneity of EC systems. N2O coordinates edge servers in a fully distributed manner toward a common goal of maximizing ASP's reward. It requires only local communications during execution and provides provable performance guarantees. The knowledge distilling is further utilized to distill the N2O policy for reducing the communication overhead and stabilizing the decision-making. We also carry out systematic experiments to show the advantages of our method over stat--of-the-art alternatives.

MPDM: A Multi-Paradigm Deployment Model for Large-scale Edge-Cloud Intelligence

AI-oriented Workload Allocation for Cloud-Edge Computing.

Extendable Multi-Device Collaborative Pipeline Parallel Inference in the Edge-Cloud Scenario

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Decentralized Edge Intelligence-Driven Network Resource Orchestration Mechanism

Data-Intensive Application Deployment at Edge: A Deep Reinforcement Learning Approach

PDM: Privacy-Aware Deployment of Machine-Learning Applications for Industrial Cyber–Physical Cloud Systems

An Online Orchestration Mechanism for General-Purpose Edge Computing

Online Learning for Orchestration of Inference in Multi-User End-Edge-Cloud Networks

Multi-Compression Scale DNN Inference Acceleration based on Cloud-Edge-End Collaboration

Seek Common While Shelving Differences: Orchestrating Deep Neural Networks for Edge Service Provisioning

DPMA: a Distributed Profit-Based Placement Scheme for Multi-Sp Mobile Edge Computing

Cloud-edge-device collaboration mechanisms of deep learning models for smart robots in mass personalization

Collaborative on-demand dynamic deployment via deep reinforcement learning for IoV service in multi edge clouds

Scenario-Based AI Benchmark Evaluation of Distributed Cloud/Edge Computing Systems

Joint Optimization of Service Migration and Resource Allocation in Mobile Edge–Cloud Computing

IDEC: Intelligent Distributed Edge Computing System Architecture Enabling Deep Learning across Heterogeneous IoT Devices

Collaborative Cloud-Edge Service Cognition Framework for DNN Configuration toward Smart IIoT

Efficient Architecture Paradigm for Deep Learning Inference As a Service.

Joint Multi-User DNN Partitioning and Computational Resource Allocation for Collaborative Edge Intelligence

Multi-mobile vehicles task offloading for vehicle-edge-cloud collaboration: A dependency-aware and deep reinforcement learning approach