Edge-device Collaborative Computing for Multi-view Classification

Marco Palena,Tania Cerquitelli,Carla Fabiana Chiasserini

2024-09-24

Abstract:Motivated by the proliferation of Internet-of-Thing (IoT) devices and the rapid advances in the field of deep learning, there is a growing interest in pushing deep learning computations, conventionally handled by the cloud, to the edge of the network to deliver faster responses to end users, reduce bandwidth consumption to the cloud, and address privacy concerns. However, to fully realize deep learning at the edge, two main challenges still need to be addressed: (i) how to meet the high resource requirements of deep learning on resource-constrained devices, and (ii) how to leverage the availability of multiple streams of spatially correlated data, to increase the effectiveness of deep learning and improve application-level performance. To address the above challenges, we explore collaborative inference at the edge, in which edge nodes and end devices share correlated data and the inference computational burden by leveraging different ways to split computation and fuse data. Besides traditional centralized and distributed schemes for edge-end device collaborative inference, we introduce selective schemes that decrease bandwidth resource consumption by effectively reducing data redundancy. As a reference scenario, we focus on multi-view classification in a networked system in which sensing nodes can capture overlapping fields of view. The proposed schemes are compared in terms of accuracy, computational expenditure at the nodes, communication overhead, inference latency, robustness, and noise sensitivity. Experimental results highlight that selective collaborative schemes can achieve different trade-offs between the above performance metrics, with some of them bringing substantial communication savings (from 18% to 74% of the transmitted data with respect to centralized inference) while still keeping the inference accuracy well above 90%.

Machine Learning,Artificial Intelligence,Distributed, Parallel, and Cluster Computing,Networking and Internet Architecture

What problem does this paper attempt to address?

The paper aims to address the issue of multi-view classification in edge computing, specifically focusing on how to efficiently perform deep learning tasks on resource-constrained devices such as IoT devices. The paper proposes and explores several collaborative inference schemes to tackle the following two main challenges:

1. **Resource Constraints**: Deep learning tasks require substantial computational and memory resources, while most edge devices have limited computational, memory, energy, and communication capabilities for real-time inference tasks.
2. **Data Redundancy and Fusion**: Due to the typically redundant or overlapping deployment of IoT devices, the collected data streams exhibit significant spatial correlation. The challenge is how to effectively utilize these spatially correlated data to improve the accuracy of fine-grained inference tasks while reducing communication and coordination costs.

To address these challenges, the paper proposes several collaborative inference mechanisms, including centralized, distributed, and selective schemes, which allow edge nodes and end devices to share data and computational burdens. The selective scheme reduces unnecessary communication overhead by deciding whether to transmit specific views based on contextual information. Experimental results show that the selective collaborative scheme can achieve significant communication savings (reducing transmitted data by 18% to 74%) while maintaining high accuracy. Additionally, even without discarding any views, performing part of the computation on end devices can significantly reduce bandwidth consumption while maintaining a high average accuracy (between 71.92% and 83.75%). The paper also details the performance of different schemes in terms of network performance, data-related attributes, and discusses their potential application scenarios in real-world applications.