Abstract:Randomized (dithered) quantization is a method capable of achieving white reconstruction error independent of the source. Dithered quantizers have traditionally been considered within their natural setting of uniform quantization. In this paper we extend conventional dithered quantization to nonuniform quantization, via a subterfage: dithering is performed in the companded domain. Closed form necessary conditions for optimality of the compressor and expander mappings are derived for both fixed and variable rate randomized quantization. Numerically, mappings are optimized by iteratively imposing these necessary conditions. The framework is extended to include an explicit constraint that deterministic or randomized quantizers yield reconstruction error that is uncorrelated with the source. Surprising theoretical results show direct and simple connection between the optimal constrained quantizers and their unconstrained counterparts. Numerical results for the Gaussian source provide strong evidence that the proposed constrained randomized quantizer outperforms the conventional dithered quantizer, as well as the constrained deterministic quantizer. Moreover, the proposed constrained quantizer renders the reconstruction error nearly white. In the second part of the paper, we investigate whether uncorrelated reconstruction error requires random coding to achieve asymptotic optimality. We show that for a Gaussian source, the optimal vector quantizer of asymptotically high dimension whose quantization error is uncorrelated with the source, is indeed random. Thus, random encoding in this setting of rate-distortion theory, is not merely a tool to characterize performance bounds, but a required property of quantizers that approach such bounds.

Conditional constrained and unconstrained quantization for probability distributions

Constrained quantization for a uniform distribution

Conditional quantization for uniform distributions on line segments and regular polygons

Conditional optimal sets and the quantization coefficients for some uniform distributions

Constrained quantization for the Cantor distribution with a family of constraints

Quantization for a Mixture of Uniform Distributions Associated with Probability Vectors

Quantization for a set of discrete distributions on the set of natural numbers

Conditional constrained and unconstrained quantization for a uniform distribution on a hexagon

Optimal quantization for a probability measure on a nonuniform stretched Sierpiński triangle

Quantum Conditional Probabilities and New Measures of Quantum Information

Quantization dimension of probability measures

Optimal quantizers for a nonuniform distribution on a Sierpinski carpet

On Constrained Randomized Quantization

Sufficient conditions, lower bounds and trade-off relations for quantumness in Kirkwood-Dirac quasiprobability

Uniform decomposition of probability measures: quantization, clustering and rate of convergence

Asymptotics for Optimal Empirical Quantization of Measures

Non-commutative probability, joint distributions, conditioning, and the associated polymorphisms

Quantization dimensions for the bi-Lipschitz recurrent Iterated function systems

Soft Quantization using Entropic Regularization

Examples of Berezin-Toeplitz Quantization: Finite sets and Unit Interval

Efficient Representation of Large-Alphabet Probability Distributions