Abstract:Motivated by the proliferation of Internet-of-Thing (IoT) devices and the rapid advances in the field of deep learning, there is a growing interest in pushing deep learning computations, conventionally handled by the cloud, to the edge of the network to deliver faster responses to end users, reduce bandwidth consumption to the cloud, and address privacy concerns. However, to fully realize deep learning at the edge, two main challenges still need to be addressed: (i) how to meet the high resource requirements of deep learning on resource-constrained devices, and (ii) how to leverage the availability of multiple streams of spatially correlated data, to increase the effectiveness of deep learning and improve application-level performance. To address the above challenges, we explore collaborative inference at the edge, in which edge nodes and end devices share correlated data and the inference computational burden by leveraging different ways to split computation and fuse data. Besides traditional centralized and distributed schemes for edge-end device collaborative inference, we introduce selective schemes that decrease bandwidth resource consumption by effectively reducing data redundancy. As a reference scenario, we focus on multi-view classification in a networked system in which sensing nodes can capture overlapping fields of view. The proposed schemes are compared in terms of accuracy, computational expenditure at the nodes, communication overhead, inference latency, robustness, and noise sensitivity. Experimental results highlight that selective collaborative schemes can achieve different trade-offs between the above performance metrics, with some of them bringing substantial communication savings (from 18% to 74% of the transmitted data with respect to centralized inference) while still keeping the inference accuracy well above 90%.

Device-Cloud Collaborative Intelligent Computing: Key Problems, Methods, and Applications

Collaborative Learning Between Cloud and End Devices

End-Edge-Cloud Collaborative Computing for Deep Learning: A Comprehensive Survey

Research on Big Data Processing Model of Edge-Cloud Collaboration in Cyber Physical Systems

Understanding Sensor Data Using Deep Learning Methods on Resource-Constrained Edge Devices.

Cloud-edge-device Collaboration Mechanisms of Cloud Manufacturing for Customized and Personalized Products

An edge-cloud collaborative computing platform for building AIoT applications efficiently

Edge-device Collaborative Computing for Multi-view Classification

Cloud-edge-device collaboration mechanisms of deep learning models for smart robots in mass personalization

Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI

Device-Cloud Collaborative Learning for Recommendation

Intelligence-Empowered Mobile Edge Computing: Framework, Issues, Implementation, and Outlook

Application Scenarios of Edge Computing in Conjunction with Cloud Computing and Artificial Intelligence

In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning

Computational Offloading in Semantic-Aware Cloud-Edge-End Collaborative Networks

An Overview on Edge Computing Research

Convergence of Recommender Systems and Edge Computing: A Comprehensive Survey

Science Driven Innovations Powering Mobile Product: Cloud AI vs. Device AI Solutions on Smart Device

Implementation of Big AI Models for Wireless Networks with Collaborative Edge Computing

A Survey on End-Edge-Cloud Orchestrated Network Computing Paradigms: Transparent Computing, Mobile Edge Computing, Fog Computing, and Cloudlet