Abstract:Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Deploying deep-learning-based intelligence near the end-user enhances privacy protection, responsiveness, and reliability. Resource-constrained end-devices must be carefully managed in order to meet the latency and energy requirements of computationally-intensive deep learning services. Collaborative end-edge-cloud computing for deep learning provides a range of performance and efficiency that can address application requirements through computation offloading. The decision to offload computation is a communication-computation co-optimization problem that varies with both system parameters (e.g., network condition) and workload characteristics (e.g., inputs). On the other hand, deep learning model optimization provides another source of tradeoff between latency and model accuracy. An end-to-end decision-making solution that considers such computation-communication problem is required to synergistically find the optimal offloading policy and model for deep learning services. To this end, we propose a reinforcement-learning-based computation offloading solution that learns optimal offloading policy considering deep learning model selection techniques to minimize response time while providing sufficient accuracy. We demonstrate the effectiveness of our solution for edge devices in an end-edge-cloud system and evaluate with a real-setup implementation using multiple AWS and ARM core configurations. Our solution provides 35% speedup in the average response time compared to the state-of-the-art with less than 0.9% accuracy reduction, demonstrating the promise of our online learning framework for orchestrating DL inference in end-edge-cloud systems.

An Adaptive Dropout Deep Computation Model for Industrial IoT Big Data Learning with Crowdsourcing to Cloud Computing

An Incremental Deep Convolutional Computation Model for Feature Learning on Industrial Big Data

A Dropconnect Deep Computation Model for Highly Heterogeneous Data Feature Learning in Mobile Sensing Networks

Dependable Deep Computation Model for Feature Learning on Big Data in Cyber-Physical Systems.

A Canonical Polyadic Deep Convolutional Computation Model for Big Data Feature Learning in Internet of Things

Research on Cloud Side Collaboration Architecture and Lightweight Model of Distribution Network

Towards Deep Learning on Resource-Constrained Robots: A Crowdsourcing Approach with Model Partition

A Deep Residual Computation Model for Heterogeneous Data Learning in Smart Internet of Things

Privacy-Preserving Double-Projection Deep Computation Model with Crowdsourcing on Cloud for Big Data Feature Learning

A Novel Adaptive Computation Offloading Strategy for Collaborative DNN Inference over Edge Devices.

Computational Intelligence and Deep Learning for Next-Generation Edge-Enabled Industrial IoT

Online Learning for Orchestration of Inference in Multi-User End-Edge-Cloud Networks

Cloud-Edge Collaboration with Green Scheduling and Deep Learning for Industrial Internet of Things

A Tensor-Train Deep Computation Model for Industry Informatics Big Data Feature Learning

ADC-DL: Communication-Efficient Distributed Learning with Hierarchical Clustering and Adaptive Dataset Condensation

A Cloud-Edge Collaborative Framework for Adaptive Quality Prediction Modeling in IIoT

Deep Reinforcement Learning Based Iterative Participant Selection Method for Industrial IoT Big Data Mobile Crowdsourcing

Collaborate Edge and Cloud Computing With Distributed Deep Learning for Smart City Internet of Things

Crowdtraining: Architecture and Incentive Mechanism for Deep Learning Training in the Internet of Things

Computation Offloading and Resource Allocation Based on Distributed Deep Learning and Software Defined Mobile Edge Computing

End-Edge Collaborative Inference of Convolutional Fuzzy Neural Networks for Big Data-Driven Internet of Things