Abstract:This paper investigates task-oriented communication for multi-device cooperative edge inference, where a group of distributed low-end edge devices transmit the extracted features of local samples to a powerful edge server for inference. While cooperative edge inference can overcome the limited sensing capability of a single device, it substantially increases the communication overhead and may incur excessive latency. To enable low-latency cooperative inference, we propose a learning-based communication scheme that optimizes local feature extraction and distributed feature encoding in a task-oriented manner, i.e., to remove data redundancy and transmit information that is essential for the downstream inference task rather than reconstructing the data samples at the edge server. Specifically, we leverage an information bottleneck (IB) principle to extract the task-relevant feature at each edge device and adopt a distributed information bottleneck (DIB) framework to formalize a single-letter characterization of the optimal rate-relevance tradeoff for distributed feature encoding. To admit flexible control of the communication overhead, we extend the DIB framework to a distributed deterministic information bottleneck (DDIB) objective that explicitly incorporates the representational costs of the encoded features. As the IB-based objectives are computationally prohibitive for high-dimensional data, we adopt variational approximations to make the optimization problems tractable. To compensate the potential performance loss due to the variational approximations, we also develop a selective retransmission (SR) mechanism to identify the redundancy in the encoded features of multiple edge devices to attain additional communication overhead reduction. Extensive experiments evidence that the proposed task-oriented communication scheme achieves a better rate-relevance tradeoff than baseline methods.

Multi-Task-Oriented Broadcast for Edge AI Inference via Information Bottleneck

Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach

Task-Oriented Communication for Multi-Device Cooperative Edge Inference

Task-Oriented Communication for Edge Video Analytics

Integrated Sensing-Communication-Computation for Over-the-Air Edge AI Inference

Over-the-Air Computation Empowered Vertically Split Inference

Task-oriented Over-the-air Computation for Edge-device Co-inference with Balanced Classification Accuracy

Task-Oriented Communication for Multi-Device Edge Inference: A Maximal Coding Rate Reduction Approach

Communication-Efficient Vertically Split Inference Via Over-the-Air Computation

Communication-Efficient Edge AI Inference Over Wireless Networks

Collaborative Edge AI Inference over Cloud-RAN

Joint Device Scheduling and Resource Allocation for ISCC-Based Multi-View-Multi-Task Inference

Energy-Efficient Processing and Robust Wireless Cooperative Transmission for Edge Inference

Task-Oriented Sensing, Computation, and Communication Integration for Multi-Device Edge AI

Task-Oriented Communication with Out-of-Distribution Detection: An Information Bottleneck Framework

Private Collaborative Edge Inference via Over-the-Air Computation

PIB: Prioritized Information Bottleneck Framework for Collaborative Edge Video Analytics

Importance-Aware Data Pre-Processing and Device Scheduling for Multi-Channel Edge Learning

Toward Real-Time Edge AI: Model-Agnostic Task-Oriented Communication with Visual Feature Alignment

Bandwidth-efficient multi-task AI inference with dynamic task importance for the Internet of Things in edge computing

Compression before Fusion: Broadcast Semantic Communication System for Heterogeneous Tasks