Abstract:Edge computing (EC) platforms, which enable Application Service Providers (ASPs) to deploy applications in close proximity to users, are providing ultra-low latency and location-awareness to a rich portfolio of services. As monetary costs are incurred for renting computing resources on edge servers to enable service provisioning, ASP has to cautiously decide where to deploy the application and how much resources would be needed to deliver satisfactory performance. However, the service provisioning problem exhibits complex correlations with multifarious factors in EC systems, ranging from user behavior to computation offloading, which are difficult to be fully captured by mathematical modeling and also put off traditional machine learning techniques due to the induction of high-dimension state space. The recent success of deep learning (DL) underpins new tools for addressing our problem. While previous works provide valuable insights on applying DL techniques, e.g., distributed DL, deep reinforcement learning (DRL), and multi-agent DL, in EC systems, these techniques cannot solely handle the distributed and heterogeneous nature of EC systems. To address these limitations, we propose a novel framework based on multi-agent DRL, distributed neural network orchestration (N2O), and knowledge distilling. The multi-agent DRL enables edge servers to learn deep neural networks that shelve distinct features learned from local edge sites and hence caters to the heterogeneity of EC systems. N2O coordinates edge servers in a fully distributed manner toward a common goal of maximizing ASP's reward. It requires only local communications during execution and provides provable performance guarantees. The knowledge distilling is further utilized to distill the N2O policy for reducing the communication overhead and stabilizing the decision-making. We also carry out systematic experiments to show the advantages of our method over stat--of-the-art alternatives.

Towards scalable and efficient Deep-RL in edge computing: A game-based partition approach

Deep reinforcement learning based resource allocation in edge-cloud gaming

Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing

Adaptive Task Offloading in Coded Edge Computing: A Deep Reinforcement Learning Approach

Data-Intensive Application Deployment at Edge: A Deep Reinforcement Learning Approach

EdgeRL: Reinforcement Learning-driven Deep Learning Model Inference Optimization at Edge

DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications

A Deep Reinforcement Learning Approach to Multi-Component Job Scheduling in Edge Computing

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

Deep reinforcement learning-based resource scheduling for energy optimization and load balancing in SDN-driven edge computing

Seek Common While Shelving Differences: Orchestrating Deep Neural Networks for Edge Service Provisioning

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

Edge–IoT Computing and Networking Resource Allocation for Decomposable Deep Learning Inference

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

CU-DRL: A Novel Deep Reinforcement Learning-assisted Offloading Scheme for Supporting Vehicular Edge Computing

Distributed Training for Deep Learning Models On An Edge Computing Network Using ShieldedReinforcement Learning

Decentralized Task Offloading in Edge Computing: An Offline-to-Online Reinforcement Learning Approach

Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing

A Transferable Approach for Partitioning Machine Learning Models on Multi-Chip-Modules