Abstract:Mobile applications can leverage high-quality deep learning models such as convolutional neural networks and deep neural networks to provide high-performance cognitive services. Prior work on deep learning models-based mobile applications in a cloud-edge computing environment focuses on performing lightweight data pre-processing tasks on edge servers for cloud-hosted cognitive servers. These approaches have two major limitations. First, it is uneasy for the mobile applications to assure satisfactory user experience in terms of network communication delay, because the intermediary edge servers are used only to pre-process data (e.g., images and videos) and the cloud servers are used to complete the tasks. Second, these approaches assume the pre-trained deep learning models deployed on cloud servers are static, and will not attempt to automatically upgrade in a context-aware manner. In this article, we propose a cloud-edge collaboration framework that facilitates delivering cognitive services with long-lasting, fast response, and high accuracy properties. We fist deploy a shallow model (i.e., EdgeCNN) on the edge server and a deep model (i.e., CloudCNN) on the cloud server. EdgeCNN can provide durable and rapid response cognitive services, because edge servers not only provide computing resources for mobile applications, but also close to users. Then, we enable CloudCNN to assist in training EdgeCNN to improve the performance of the latter. Thus, EdgeCNN also provides high-accuracy cognitive services. Furthermore, because users may continue to upload data to edge servers in real-world scenarios, we propose to use the ongoing assistance of CloudCNN to further improve the accuracy of the shallow model. Experimental results show that EdgeCNN can reduce the average response time of cognitive services by up to 55.08 percent and improve accuracy by up to 26.70 percent.

A Cloud-Edge-Smart IoT Architecture for Speeding up the Deployment of Neural Network Models with Transfer Learning Techniques

Extendable Multi-Device Collaborative Pipeline Parallel Inference in the Edge-Cloud Scenario

Efficient Partitioning and Communication Scheme-Based Distributed Edge Computing to Accelerate Deep Neural Network

AccEPT: an Acceleration Scheme for Speeding Up Edge Pipeline-parallel Training

A collaborative cloud-edge computing framework in distributed neural network

Joint Compressing and Partitioning of CNNs for Fast Edge-Cloud Collaborative Intelligence for IoT

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments

Offloading and Transmission Strategies for IoT Edge Devices and Networks

Edge-Cloud Cooperation for DNN Inference Via Reinforcement Learning and Supervised Learning

Low Latency Deep Learning Inference Model for Distributed Intelligent IoT Edge Clusters

Memory-efficient Deep Learning Inference with Incremental Weight Loading and Data Layout Reorganization on Edge Systems.

A Cloud-Edge Collaboration Framework for Cognitive Service.

Optimizing Resource-Efficiency for Federated Edge Intelligence in IoT Networks

An Adaptive Neural Architecture Search Design for Collaborative Edge-Cloud Computing

Communication-Efficient Separable Neural Network for Distributed Inference on Edge Devices

Dynamic Data Collection and Neural Architecture Search for Wireless Edge Intelligence Systems.

Design of a Novel Neural Network Compression Method for Tiny Machine Learning

Deploy Large-Scale Deep Neural Networks in Resource Constrained IoT Devices with Local Quantization Region

Efficient Intrusion Detection Toward IoT Networks Using Cloud–edge Collaboration

Joint Architecture Design and Workload Partitioning for DNN Inference on Industrial IoT Clusters

AI on the Edge: Rethinking AI-based IoT Applications Using Specialized Edge Architectures