Abstract:This paper deals with the computation of a non-asymptotic lower bound by means of the nonanticipative rate-distortion function (NRDF) on the discrete-time zero-delay variable-rate lossy compression problem for discrete Markov sources with per-stage, single-letter distortion. First, we derive a new information structure of the NRDF for Markov sources and single-letter distortions. Second, we derive new convexity results on the NRDF, which facilitate the use of Lagrange duality theorem to cast the problem as an unconstrained partially observable finite-time horizon stochastic dynamic programming (DP) algorithm subject to a probabilistic state (belief state) that summarizes the past information about the reproduction symbols and takes values in a continuous state space. Instead of approximating the DP algorithm directly, we use Karush-Kuhn-Tucker (KKT) conditions to find an implicit closed-form expression of the optimal control policy of the stochastic DP (i.e., the minimizing distribution of the NRDF) and approximate the control policy and the cost-to-go function (a function of the rate) stage-wise, via a novel dynamic alternating minimization (AM) approach, that is realized by an offline algorithm operating using backward recursions, with provable convergence guarantees. We obtain the clean values of the aforementioned quantities using an online (forward) algorithm operating for any finite-time horizon. Our methodology provides an approximate solution to the exact NRDF solution, which becomes near-optimal as the search space of the belief state becomes sufficiently large at each time stage. We corroborate our theoretical findings with simulation studies where we apply our algorithms assuming time-varying and time-invariant binary Markov processes.

Nonanticipative Rate Distortion Function for General Source-Channel Matching

Threshold-Based Hybrid Selection/Maximal-Ratio Combining Over Generalized Fading Channels

Multi-Level Distribution Matching.

Bit-Level Probabilistically Shaped Coded Modulation

A Rate-Distortion Analysis for Composite Sources Under Subsource-Dependent Fidelity Criteria

Indirect Rate Distortion Functions with Side Information: Structural Properties and Multivariate Gaussian Sources

Mismatched Rate-Distortion Theory: Ensembles, Bounds, and General Alphabets

A New Finite-Horizon Dynamic Programming Analysis of Nonanticipative Rate-Distortion Function for Markov Sources

Rate-Distortion-Perception Tradeoff Based on the Conditional-Distribution Perception Measure

Source Coding with Mismatched Distortion Measures

Structural Properties of the Wyner–Ziv Rate Distortion Function: Applications for Multivariate Gaussian Sources

An Achievable Rate-Distortion Region for Joint State and Message Communication over Multiple Access Channels

Mismatched Multi-Letter Successive Decoding for the Multiple-Access Channel

Rate-Distortion Performance of Sequential Massive Random Access to Gaussian Sources with Memory

Pre-Decoder Processing Functions for a DMC with Mismatched Decoding

Rate-varying Space-Time Coding Scheme for Multiple-Input Multiple-Output Fading Channel with Zero-Forcing Receiver

Indirect Rate Distortion Functions with $f$-Separable Distortion Criterion

Rate-Distortion-Perception Tradeoff of Variable-Length Source Coding for General Information Sources

Rate-distortion Bound for a Class of Non-Gaussian Sources with Memory

Competitive Channel-Capacity

Rateless Stochastic Coding for Delay-constrained Semantic Communication