Abstract:Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Deploying deep-learning-based intelligence near the end-user enhances privacy protection, responsiveness, and reliability. Resource-constrained end-devices must be carefully managed in order to meet the latency and energy requirements of computationally-intensive deep learning services. Collaborative end-edge-cloud computing for deep learning provides a range of performance and efficiency that can address application requirements through computation offloading. The decision to offload computation is a communication-computation co-optimization problem that varies with both system parameters (e.g., network condition) and workload characteristics (e.g., inputs). On the other hand, deep learning model optimization provides another source of tradeoff between latency and model accuracy. An end-to-end decision-making solution that considers such computation-communication problem is required to synergistically find the optimal offloading policy and model for deep learning services. To this end, we propose a reinforcement-learning-based computation offloading solution that learns optimal offloading policy considering deep learning model selection techniques to minimize response time while providing sufficient accuracy. We demonstrate the effectiveness of our solution for edge devices in an end-edge-cloud system and evaluate with a real-setup implementation using multiple AWS and ARM core configurations. Our solution provides 35% speedup in the average response time compared to the state-of-the-art with less than 0.9% accuracy reduction, demonstrating the promise of our online learning framework for orchestrating DL inference in end-edge-cloud systems.

Learning for Smart Edge: Cognitive Learning-Based Computation Offloading

An efficient method of computation offloading in an edge cloud platform

Cooperative Computation Offloading and Dynamic Task Scheduling in Edge Computing

Computational Offloading in Semantic-Aware Cloud-Edge-End Collaborative Networks

Smart-Edge-CoCaCo: AI-Enabled Smart Edge with Joint Computation, Caching, and Communication in Heterogeneous IoT

A computational offloading optimization scheme based on deep reinforcement learning in perceptual network

Collaborative Cloud and Edge Computing for Latency Minimization

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Online Learning for Orchestration of Inference in Multi-User End-Edge-Cloud Networks

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Online Learning Offloading Framework for Heterogeneous Mobile Edge Computing System

Online Computation Offloading and Resource Scheduling in Mobile-Edge Computing

Deep reinforcement learning-based online task offloading in mobile edge computing networks

An efficient computational offloading framework using HAA optimization-based deep reinforcement learning in edge-based cloud computing architecture

Machine learning-based computation offloading in edge and fog: a systematic review

Deep reinforcement learning‐based multitask hybrid computing offloading for multiaccess edge computing

Cost-Minimized Computation Offloading and User Association in Hybrid Cloud and Edge Computing

Computation Cost-Driven Offloading Strategy Based On Reinforcement Learning for Consumer Devices

A Joint Time and Energy-Efficient Federated Learning-based Computation Offloading Method for Mobile Edge Computing

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Joint Optimization of Task Caching and Computation Offloading for Multiuser Multitasking in Mobile Edge Computing