Abstract:This paper investigates task-oriented communication for multi-device cooperative edge inference, where a group of distributed low-end edge devices transmit the extracted features of local samples to a powerful edge server for inference. While cooperative edge inference can overcome the limited sensing capability of a single device, it substantially increases the communication overhead and may incur excessive latency. To enable low-latency cooperative inference, we propose a learning-based communication scheme that optimizes local feature extraction and distributed feature encoding in a task-oriented manner, i.e., to remove data redundancy and transmit information that is essential for the downstream inference task rather than reconstructing the data samples at the edge server. Specifically, we leverage an information bottleneck (IB) principle to extract the task-relevant feature at each edge device and adopt a distributed information bottleneck (DIB) framework to formalize a single-letter characterization of the optimal rate-relevance tradeoff for distributed feature encoding. To admit flexible control of the communication overhead, we extend the DIB framework to a distributed deterministic information bottleneck (DDIB) objective that explicitly incorporates the representational costs of the encoded features. As the IB-based objectives are computationally prohibitive for high-dimensional data, we adopt variational approximations to make the optimization problems tractable. To compensate the potential performance loss due to the variational approximations, we also develop a selective retransmission (SR) mechanism to identify the redundancy in the encoded features of multiple edge devices to attain additional communication overhead reduction. Extensive experiments evidence that the proposed task-oriented communication scheme achieves a better rate-relevance tradeoff than baseline methods.

Self-aware Collaborative Edge Inference with Embedded Devices for Task-oriented IIoT

Extendable Multi-Device Collaborative Pipeline Parallel Inference in the Edge-Cloud Scenario

Joint Architecture Design and Workload Partitioning for DNN Inference on Industrial IoT Clusters

Edge-based Collaborative Training System for Artificial Intelligence-of-Things

EdgeCI: Distributed Workload Assignment and Model Partitioning for CNN Inference on Edge Clusters

Bandwidth-efficient multi-task AI inference with dynamic task importance for the Internet of Things in edge computing

IDEC: Intelligent Distributed Edge Computing System Architecture Enabling Deep Learning across Heterogeneous IoT Devices

Collaborative Inference for AI-Empowered IoT Devices

Energy-Aware Selective Inference Task Offloading for Real-Time Edge Computing Applications

Task-Oriented Communication for Multi-Device Cooperative Edge Inference

AI on the Edge: Rethinking AI-based IoT Applications Using Specialized Edge Architectures

Self-aware distributed deep learning framework for heterogeneous IoT edge devices

Collaborative Inference for Deep Neural Networks in Edge Environments

Incentive-Driven Task Allocation for Collaborative Edge Computing in Industrial Internet of Things

Low Latency Deep Learning Inference Model for Distributed Intelligent IoT Edge Clusters

Edge Learning for Large-Scale Internet of Things With Task-Oriented Efficient Communication

Edge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge Synergy

Edge-device Collaborative Computing for Multi-view Classification

Reaching for the Sky: Maximizing Deep Learning Inference Throughput on Edge Devices with AI Multi-Tenancy

Integrated Sensing-Communication-Computation for Over-the-Air Edge AI Inference