Abstract:This paper investigates task-oriented communication for multi-device cooperative edge inference, where a group of distributed low-end edge devices transmit the extracted features of local samples to a powerful edge server for inference. While cooperative edge inference can overcome the limited sensing capability of a single device, it substantially increases the communication overhead and may incur excessive latency. To enable low-latency cooperative inference, we propose a learning-based communication scheme that optimizes local feature extraction and distributed feature encoding in a task-oriented manner, i.e., to remove data redundancy and transmit information that is essential for the downstream inference task rather than reconstructing the data samples at the edge server. Specifically, we leverage an information bottleneck (IB) principle to extract the task-relevant feature at each edge device and adopt a distributed information bottleneck (DIB) framework to formalize a single-letter characterization of the optimal rate-relevance tradeoff for distributed feature encoding. To admit flexible control of the communication overhead, we extend the DIB framework to a distributed deterministic information bottleneck (DDIB) objective that explicitly incorporates the representational costs of the encoded features. As the IB-based objectives are computationally prohibitive for high-dimensional data, we adopt variational approximations to make the optimization problems tractable. To compensate the potential performance loss due to the variational approximations, we also develop a selective retransmission (SR) mechanism to identify the redundancy in the encoded features of multiple edge devices to attain additional communication overhead reduction. Extensive experiments evidence that the proposed task-oriented communication scheme achieves a better rate-relevance tradeoff than baseline methods.

Task-Decoding Assisted Cooperative Transmission for Coded Edge Computing

Cooperative Transmission with Priority and Fairness in Edge Computing Systems

Multi-Cell Mobile Edge Coded Computing: Trading Communication and Computing for Distributed Matrix Multiplication

Multiple-Task Coded Computing for Distributed Computation Framework: Modeling and Delay Analysis

Load scheduling for distributed edge computing: A communication-computation tradeoff

End-to-end Delay Analysis for Coded Computing with Multi-Task Arrival

Wireless Coded Computation with Error Detection

Block-Division-Based Wireless Coded Computation

Elastic Resource Allocation for Coded Distributed Computing Over Heterogeneous Wireless Edge Networks

Task offloading strategy to maximize task completion rate in heterogeneous edge computing environment

Transmission Order Optimization of Coded Distributed Computing in Heterogeneous Wireless Multiple-Access Network.

Task-Oriented Communication for Multi-Device Cooperative Edge Inference

Coded Caching with Device Computing in Mobile Edge Computing Systems

Delay-Aware Cache-Enabled Cooperative D2D Transmission in Mobile Cellular Networks

Delay Optimization of Coded Computing with Hierarchical Task Partitioning

Cooperative Computation Offloading and Dynamic Task Scheduling in Edge Computing

Decode-and-Compare: An Efficient Verification Scheme for Coded Distributed Edge Computing

Latency Optimization for Coded Computation Straggled by Wireless Transmission.

Edge-Facilitated Wireless Distributed Computing

Luby Transform Coded Computation with Error Detection in Wireless Networks

Heterogeneous Coded Computation Across Heterogeneous Workers.