Abstract:The design of communication systems dedicated to machine learning tasks is one key aspect of goal-oriented communications. In this framework, this article investigates the interplay between data reconstruction and learning from the same compressed observations, particularly focusing on the regression problem. We establish achievable rate-generalization error regions for both parametric and non-parametric regression, where the generalization error measures the regression performance on previously unseen data. The analysis covers both asymptotic and finite block-length regimes, providing fundamental results and practical insights for the design of coding schemes dedicated to regression. The asymptotic analysis relies on conventional Wyner-Ziv coding schemes which we extend to study the convergence of the generalization error. The finite-length analysis uses the notions of information density and dispersion with additional term for the generalization error. We further investigate the trade-off between reconstruction and regression in both asymptotic and non-asymptotic regimes. Contrary to the existing literature which focused on other learning tasks, our results state that in the case of regression, there is no trade-off between data reconstruction and regression in the asymptotic regime. We also observe the same absence of trade-off for the considered achievable scheme in the finite-length regime, by analyzing correlation between distortion and generalization error.

A Non-Uniform Regional Partition Coding of One Dimension Signal and Its Application

A non-uniform rectangular partition coding of digital image and its application

Compressed Data Separation Via Unconstrained L1-Split Analysis

Distributed Source Coding Theorem Based Region of Interest Image Compression Method

A Power Efficient Sensing/Communication Scheme: Joint Source-Channel-Network Coding by Using Compressive Sensing

A Novel Embedded Coding Algorithm Based on the Reconstructed DCT Coefficients.

Distributed Vector Quantization over Sensor Network

Distributed Coding of Quantized Random Projections

A New Region-Of-Interest Image Compression Method Based On Wyner-Ziv Coding

A Novel Image Denoising Algorithm Based on Non-uniform Rectangular Partition and Interpolation

Adaptive blocking regional DWT video coding algorithm for low bit-rate

Adaptive regional DCT/DWT video coding algorithm for low bit-rate

Fast Partition Mode Decision Via a Plug-in Fully Connected Network for Video Coding

Intra Block Partition Structure Prediction Via Convolutional Neural Network.

Wyner-Ziv Coding Based on Signal Denoising Technique

Overlapped Motion Compensated Region Wavelet Coder for Very Low Bit-Rates

A Probabilistic Shaping Approach for Optical Region-of-Interest Signaling

Distributed Source Coding for Parametric and Non-Parametric Regression

A distributed video coding scheme based on denoising techniques

Region-of-Interest Based Coding Scheme for Live Videos

Neural Distributed Compressor Discovers Binning