Abstract:Edge computing (EC) platforms, which enable Application Service Providers (ASPs) to deploy applications in close proximity to users, are providing ultra-low latency and location-awareness to a rich portfolio of services. As monetary costs are incurred for renting computing resources on edge servers to enable service provisioning, ASP has to cautiously decide where to deploy the application and how much resources would be needed to deliver satisfactory performance. However, the service provisioning problem exhibits complex correlations with multifarious factors in EC systems, ranging from user behavior to computation offloading, which are difficult to be fully captured by mathematical modeling and also put off traditional machine learning techniques due to the induction of high-dimension state space. The recent success of deep learning (DL) underpins new tools for addressing our problem. While previous works provide valuable insights on applying DL techniques, e.g., distributed DL, deep reinforcement learning (DRL), and multi-agent DL, in EC systems, these techniques cannot solely handle the distributed and heterogeneous nature of EC systems. To address these limitations, we propose a novel framework based on multi-agent DRL, distributed neural network orchestration (N2O), and knowledge distilling. The multi-agent DRL enables edge servers to learn deep neural networks that shelve distinct features learned from local edge sites and hence caters to the heterogeneity of EC systems. N2O coordinates edge servers in a fully distributed manner toward a common goal of maximizing ASP's reward. It requires only local communications during execution and provides provable performance guarantees. The knowledge distilling is further utilized to distill the N2O policy for reducing the communication overhead and stabilizing the decision-making. We also carry out systematic experiments to show the advantages of our method over stat--of-the-art alternatives.

Time-Efficient Ensemble Learning with Sample Exchange for Edge Computing

Decentralized Ensemble Learning Based on Sample Exchange among Multiple Agents.

Edge-cloud Collaborative Learning with Federated and Centralized Features

NeuE: Automated Neural Network Ensembles for Edge Intelligence

Automated Ensemble for Deep Learning Inference on Edge Computing Platforms

Toward Improving Ensemble-Based Collaborative Inference at the Edge

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

Federated Ensemble Model-Based Reinforcement Learning in Edge Computing

Importance-Driven Data Collection for Efficient Online Learning over the Wireless Edge

Cooperative Model Dissemination Strategy for Hierarchical Clustering Learning in Edge Computing

EdgeConvEns: Convolutional Ensemble Learning for Edge Intelligence

Decentralized Low-Latency Collaborative Inference via Ensembles on the Edge

Online Management for Edge-Cloud Collaborative Continuous Learning: A Two-timescale Approach

Optimizing Model Dissemination for Hierarchical Clustering Learning in Edge Computing

Joint Task and Computing Resource Allocation in Distributed Edge Computing Systems Via Multi-Agent Deep Reinforcement Learning

Seek Common While Shelving Differences: Orchestrating Deep Neural Networks for Edge Service Provisioning

An Ensemble of Random Decision Trees with Local Differential Privacy in Edge Computing

Lightweight Decentralized Federated Learning Framework for Heterogeneous Edge Systems

Selective Federated Learning for Mobile Edge Intelligence

Collective Deep Reinforcement Learning for Intelligence Sharing in the Internet of Intelligence-Empowered Edge Computing

Real-Time Edge Intelligence in the Making: A Collaborative Learning Framework via Federated Meta-Learning