Abstract:In this work, the problem of communicating decisions of a classifier over a noisy channel is considered. With machine learning based models being used in variety of time-sensitive applications, transmission of these decisions in a reliable and timely manner is of significant importance. To this end, we study the scenario where a probability vector (representing the decisions of a classifier) at the transmitter, needs to be transmitted over a noisy channel. Assuming that the distortion between the original probability vector and the reconstructed one at the receiver is measured via f-divergence, we study the trade-off between transmission latency and the distortion. We completely analyze this trade-off using uniform, lattice, and sparse lattice-based quantization techniques to encode the probability vector by first characterizing bit budgets for each technique given a requirement on the allowed source distortion. These bounds are then combined with results from finite-blocklength literature to provide a framework for analyzing the effects of both quantization distortion and distortion due to decoding error probability (i.e., channel effects) on the incurred transmission latency. Our results show that there is an interesting interplay between source distortion (i.e., distortion for the probability vector measured via f-divergence) and the subsequent channel encoding/decoding parameters; and indicate that a joint design of these parameters is crucial to navigate the latency-distortion tradeoff. We study the impact of changing different parameters (e.g. number of classes, SNR, source distortion) on the latency-distortion tradeoff and perform experiments on AWGN and fading channels. Our results indicate that sparse lattice-based quantization is the most effective at minimizing latency across various regimes and for sparse, high-dimensional probability vectors (i.e., high number of classes).

Distortion-transmission trade-off in real-time transmission of Markov sources

Distortion Minimization with Age of Information and Cost Constraints

A New Finite-Horizon Dynamic Programming Analysis of Nonanticipative Rate-Distortion Function for Markov Sources

Dynamic Data Compression with Distortion Constraints for Wireless Transmission over a Fading Channel

Latency-Distortion Tradeoffs in Communicating Classification Results over Noisy Channels

A General Framework for Transmission with Transceiver Distortion and Some Applications

Computable Bounds for Rate Distortion with Feed-Forward for Stationary and Ergodic Sources

Distortion Bounds for Source Broadcast Problems.

Delay-Distortion-Power Trade Offs in Quasi-Stationary Source Transmission over Block Fading Channels

On Delay-Power Tradeoff of Rate Adaptive Wireless Communications with Random Arrivals.

A Communication Optimal Transport Approach to the Computation of Rate Distortion Functions

Delay-Optimal and Energy-Efficient Communications with Markovian Arrivals

Real-time Tracking in a Status Update System with an Imperfect Feedback Channel

Tradeoff of age-of-information and power under reliability constraint for short-packet communication with block-length adaptation

Distortion Bounds for Source Broadcast over Degraded Channel

Distorted optimal transport

Delay-Power Tradeoff of Fixed-Rate Wireless Transmission with Arbitrarily Bursty Traffics

Optimization of ARQ Protocols in Interference Networks with QoS Constraints

An Optimal Transmission Strategy for Kalman Filtering Over Packet Dropping Links With Imperfect Acknowledgements

Reinforcement Learning for Optimal Transmission of Markov Sources over Noisy Channels: Belief Quantization vs Sliding Finite Window Codes

A Model for Data Transmission and Its Optimization