Quantization Errors of Uniformly Quantized Fgn and Fbm Signals.

Zhiheng Li,Yudong Chen,Li,Yi Zhang

DOI: https://doi.org/10.1109/lsp.2009.2030115

2009-01-01

IEEE Signal Processing Letters

Abstract:In this letter, we show that under the assumption of high resolution, the quantization errors of fGn and fBm signals with uniform quantizer can be treated as uncorrelated white noises.

What problem does this paper attempt to address?

Quantization Errors of fGn and fBm Signals

Zhiheng Li,Li Li,Yudong Chen,Yi Zhang

DOI: https://doi.org/10.1109/LSP.2009.2030115

2009-05-28

Abstract:In this Letter, we show that under the assumption of high resolution, the quantization errors of fGn and fBm signals with uniform quantizer can be treated as uncorrelated white noises.

Information Theory
Parameter identifiability of quantized linear systems

Shen Ying,Hui Zhang

DOI: https://doi.org/10.1109/WCICA.2012.6358412

2012-01-01

Abstract:The parameter identifiability of quantized linear systems with Gauss-Markov parameters is discussed from information theoretic point of view. The presented definition of parameter identifiability is reviewed and extended to quantized systems by considering the intrinsic property of the system. Then the parameter identifiability of linear systems with quantized outputs is analyzed and the criterion of parameter identifiability is proposed based on the measure of mutual information. Furthermore, the convergence property of the quantized parameter identifiability Gramian is analyzed. © 2012 IEEE.
Asymptotically Optimal One-Bit Quantizer Design for Weak-Signal Detection in Generalized Gaussian Noise and Lossy Binary Communication Channel.

Guanyu Wang,Jiang Zhu,Zhiwei Xu

DOI: https://doi.org/10.1016/j.sigpro.2018.09.005

IF: 4.729

2018-01-01

Signal Processing

Abstract:In this paper, quantizer design for weak-signal detection under arbitrary binary channel in generalized Gaussian noise is studied. Since the performances of the generalized likelihood ratio test (GLRT) and Rao test are asymptotically characterized by the noncentral chi-squared probability density function (PDF), the threshold design problem can be formulated as a noncentrality parameter maximization problem. The theoretical property of the noncentrality parameter with respect to the threshold is investigated, and the optimal threshold is shown to be found in polynomial time with appropriate numerical algorithm and proper initializations. In certain cases, the optimal threshold is proved to be zero. Finally, numerical experiments are conducted to substantiate the theoretical analysis.
Response of Quasi-Integrable and Non-Resonant Hamiltonian Systems to Fractional Gaussian Noise

Qiangfeng Lu,Weiqiu Zhu,Maolin Deng

DOI: https://doi.org/10.1109/access.2020.2987822

IF: 3.9

2020-01-01

IEEE Access

Abstract:The main difficulty of analyzing the response of nonlinear dynamical systems to fractional Gaussian noise (fGn) is the non-Markov property and non-usefulness of diffusion process theory. Currently, only numerical simulation can be applied to obtain the response of nonlinear systems to fGn. In the present paper, noting the rather flat property of the fGn power spectral density (PSD) in most part of frequency band, the stochastic averaging method for quasi-integrable Hamiltonian systems under wide-band noise excitation is applied to predict the response of quasi-integrable and non-resonant Hamiltonian systems to fGn. By using this method, the averaged Itô stochastic differential equations (SDEs) are established and the probability density function (PDF) of system response can be obtained from solving the corresponding Fokker-Planck-Kolmogorov (FPK) equation. All of the statistics of system response are then obtained from the PDF analytically and verified through the comparison with the simulation results.
Quantization Errors of Modulo Sigma-Delta Modulated ARMA Processes

Li Li,Yudong Chen

DOI: https://doi.org/10.1109/ChinaSIP.2013.6625303

2014-06-07

Abstract:In this paper, we study the quantization errors of modulo sigma-delta modulated finite, asymptotically-infinite, infinite causal stable ARMA processes. We prove that the normalized quantization error can be taken as a uniformly distributed white noise for all the cases. Moreover, we find that this nice property is guaranteed by two different mechanisms: the high-enough quantization resolution \cite{Bennett1948}-\cite{WidrowKollar2008} and the asymptotic convergence of quantization errors for some quasi-stationary processes \cite{ChouGray1991}-\cite{LiChenLiZhang2009}, for different cases. But the assumption of the smooth density of the sampled random processes is needed in all the cases.

Information Theory,Networking and Internet Architecture
Vector Quantization with Error Uniformly Distributed over an Arbitrary Set

Chih Wei Ling,Cheuk Ting Li

2024-01-24

Abstract:For uniform scalar quantization, the error distribution is approximately a uniform distribution over an interval (which is also a 1-dimensional ball). Nevertheless, for lattice vector quantization, the error distribution is uniform not over a ball, but over the basic cell of the quantization lattice. In this paper, we construct vector quantizers with periodic properties, where the error is uniformly distributed over the n-ball, or any other prescribed set. We then prove upper and lower bounds on the entropy of the quantized signals. We also discuss how our construction can be applied to give a randomized quantization scheme with a nonuniform error distribution.

Information Theory
Asymptotics of the quantization errors for some Markov-type measures with complete overlaps

Sanguo Zhu

2023-07-11

Abstract:Let $\mathcal{G}$ be a directed graph with vertices $1,2,\ldots, 2N$. Let $\mathcal{T}=(T_{i,j})_{(i,j)\in\mathcal{G}}$ be a family of contractive similitudes. For every $1\leq i\leq N$, let $i^+:=i+N$. For $1\leq i,j\leq N$, we define $\mathcal{M}_{i,j}=\{(i,j),(i,j^+),(i^+,j),(i^+,j^+)\}\cap\mathcal{G}$. We assume that $T_{\widetilde{i},\widetilde{j}}=T_{i,j}$ for every $(\widetilde{i},\widetilde{j})\in \mathcal{M}_{i,j}$. Let $K$ denote the Mauldin-Williams fractal determined by $\mathcal{T}$. Let $\chi=(\chi_i)_{i=1}^{2N}$ be a positive probability vector and $P$ a row-stochastic matrix which serves as an incidence matrix for $\mathcal{G}$. We denote by $\nu$ the Markov-type measure associated with $\chi$ and $P$. Let $\Omega=\{1,\ldots,2N\}$ and $G_\infty=\{\sigma\in\Omega^{\mathbb{N}}:(\sigma_i,\sigma_{i+1})\in\mathcal{G}, \;i\geq 1\}$. Let $\pi$ be the natural projection from $G_\infty$ to $K$ and $\mu=\nu\circ\pi^{-1}$. We consider the following two cases: 1. $\mathcal{G}$ has two strongly connected components consisting of $N$ vertices; 2. $\mathcal{G}$ is strongly connected. With some assumptions for $\mathcal{G}$ and $\mathcal{T}$, for case 1, we determine the exact value $s_r$ of the quantization dimension $D_r(\mu)$ for $\mu$ and prove that the $s_r$-dimensional lower quantization coefficient is always positive, but the upper one can be infinite; we establish a necessary and sufficient condition for the upper quantization coefficient for $\mu$ to be finite; for case 2, we determine $D_r(\mu)$ in terms of a pressure-like function and prove that $D_r(\mu)$-dimensional upper and lower quantization coefficient are both positive and finite.

Functional Analysis,Information Theory
Asymptotic local uniformity of the quantization error for Ahlfors-David probability measures

Sanguo Zhu

DOI: https://doi.org/10.48550/arXiv.1708.07657

2018-02-26

Abstract:Let $\mu$ be an Ahlfors-David probability measure on $\mathbb{R}^q$, namely, there exist some constants $s_0>0$ and $\epsilon_0,C_1,C_2>0$ such that \[ C_1\epsilon^{s_0}\leq\mu(B(x,\epsilon))\leq C_2\epsilon^{s_0},\;\epsilon\in(0,\epsilon_0),\;x\in{\rm supp}(\mu). \] For $n\geq 1$, let $\alpha_n$ be an $n$-optimal set for $\mu$ of order $r$ and $(P_a(\alpha_n))_{a\in\alpha_n}$ an arbitrary Voronoi partition with respect to $\alpha_n$. The $n$th quantization error $e_{n,r}(\mu)$ for $\mu$ of order $r$ is given by $e^r_{n,r}(\mu):=\int d(x,\alpha_n)^rd\mu(x)$. Write \[ I_a(\alpha,\mu):=\int_{P_a(\alpha_n)}d(x,\alpha_n)^rd\mu(x),\;a\in\alpha_n. \] We prove that, $\underline{J}(\alpha_n,\mu):=\min_{a\in\alpha_n}I_a(\alpha,\mu)$, $\overline{J}(\alpha_n,\mu):=\max_{a\in\alpha_n}I_a(\alpha,\mu)$ and the error difference $e^r_{n,r}(\mu)-e^r_{n+1,r}(\mu)$ are of the same order as $\frac{1}{n}e^r_{n,r}(\mu)$. This, together with Graf and Luschgy's work, yields that all the above three quantities are of the same order as $n^{-(1+\frac{r}{s_0})}$.

Metric Geometry
Quantum channel measurement with local quantum Bernoulli noises

Qi Han,Yanan Han,Yaxin Kou,Ning Bai

DOI: https://doi.org/10.1038/s41598-022-17268-y

2022-07-28

Abstract:As an important stochastic process, quantum Bernoulli noises has a very important physical background and is an important research object in the field of quantum information. In this paper, we review local quantum Bernoulli noises and local quantum mutual entropy, then introduce quantum channel measurement with local quantum Bernoulli noises. On this basis, we give the channel structure between two systems, and prove the completely positivity of this quantum channel. We also give a channel application on the local quantum mutual entropy.
Rejection-Sampled Universal Quantization for Smaller Quantization Errors

Chih Wei Ling,Cheuk Ting Li

2024-02-05

Abstract:We construct a randomized vector quantizer which has a smaller maximum error compared to all known lattice quantizers with the same entropy for dimensions 5, 6, ..., 48, and also has a smaller mean squared error compared to known lattice quantizers with the same entropy for dimensions 35, ..., 48, in the high resolution limit. Moreover, our randomized quantizer has a desirable property that the quantization error is always uniform over the ball and independent of the input. Our construction is based on applying rejection sampling on universal quantization, which allows us to shape the error distribution to be any continuous distribution, not only uniform distributions over basic cells of a lattice as in conventional dithered quantization. We also characterize the high SNR limit of one-shot channel simulation for any additive noise channel under a mild assumption (e.g., the AWGN channel), up to an additive constant of 1.45 bits.

Information Theory,Signal Processing
Lattice Quantization Noise Revisited.

Cong Ling,Lu Gan

DOI: https://doi.org/10.1109/itw.2013.6691297

2013-01-01

Abstract:Dithered quantization is widely used in signal processing and coding due to its many desirable properties in theory and in practice. In this paper, we show that dither is unnecessary for Gaussian sources when the flatness factor of the quantization lattice is small. This means that the quantization noise behaves much like that in dithered quantization. In particular, it tends to be uniformly distributed over any fundamental region of the lattice and be uncorrelated with the signal; further, for optimum lattice quantizers, it approaches the rate-distortion bound of Gaussian sources with minimum mean-square error (MMSE) estimation.
Random Quantum Circuits Transform Local Noise into Global White Noise

Alexander M. Dalzell,Nicholas Hunter-Jones,Fernando G. S. L. Brandão

DOI: https://doi.org/10.1007/s00220-024-04958-z

IF: 2.361

2024-03-14

Communications in Mathematical Physics

Abstract:We study the distribution over measurement outcomes of noisy random quantum circuits in the regime of low fidelity, which corresponds to the setting where the computation experiences at least one gate-level error with probability close to one. We model noise by adding a pair of weak, unital, single-qubit noise channels after each two-qubit gate, and we show that for typical random circuit instances, correlations between the noisy output distribution and the corresponding noiseless output distribution shrink exponentially with the expected number of gate-level errors. Specifically, the linear cross-entropy benchmark F that measures this correlation behaves as , where is the probability of error per circuit location and s is the number of two-qubit gates. Furthermore, if the noise is incoherent—for example, depolarizing or dephasing noise—the total variation distance between the noisy output distribution and the uniform distribution decays at precisely the same rate. Consequently, the noisy output distribution can be approximated as . In other words, although at least one local error occurs with probability , the errors are scrambled by the random quantum circuit and can be treated as global white noise, contributing completely uniform output. Importantly, we upper bound the average total variation error in this approximation by . Thus, the "white-noise approximation" is meaningful when , a quadratically weaker condition than the requirement to maintain high fidelity. The bound applies if the circuit size satisfies , which corresponds to only logarithmic depth circuits, and if, additionally, the inverse error rate satisfies , which is needed to ensure errors are scrambled faster than F decays. The white-noise approximation is useful for salvaging the signal from a noisy quantum computation; for example, it was an underlying assumption in complexity-theoretic arguments that noisy random quantum circuits cannot be efficiently sampled classically, even when the fidelity is low. Our method is based on a map from second-moment quantities in random quantum circuits to expectation values of certain stochastic processes for which we compute upper and lower bounds.

physics, mathematical
The Effects Of Quantization On Multi-Layer Feedforward Neural Networks

Minghu Jiang,Georges G. E. Gielen

DOI: https://doi.org/10.1142/S0218001403002514

IF: 1.261

2003-01-01

International Journal of Pattern Recognition and Artificial Intelligence

Abstract:In this paper we investigate the combined effect of quantization and clipping on multi-layer feedforward neural networks (MLFNN). Statistical models are used to analyze the effects of quantization in a digital implementation. We analyze the performance degradation caused as a function of the number of fixed-point and floating-point quantization bits in the MLFNN. To analyze a true nonlinear neuron, we adopt the uniform and normal probability distributions, compare the training performances with and without weight clipping, and derive in detail the effect of the quantization error on forward and backward propagation. No matter what distribution the initial weights comply with, the weights distribution will approximate a normal distribution for the training of floating-point or high-precision fixed-point quantization. Only when the number of quantization bits is very low, the weights distribution may cluster to +/-1 for the training with fixed-point quantization. We establish and analyze the relationships for a true nonlinear neuron between inputs and outputs bit resolution, the number of network layers and the performance degradation, based on statistical models of on-chip and off-chip training. Our experimental simulation results verify the presented theoretical analysis.
The Quantization Effects of Different Probability Distribution on Multilayer Feedforward Neural Networks

MH Jiang,G Gielen,BX Deng,XF Tang,QQ Ruan,BZ Yuan

DOI: https://doi.org/10.1109/icosp.2002.1179999

2002-01-01

Abstract:A statistical model of quantization was used to analyze the effects of quantization in digital implementation, and the performance degradation caused by number of quantized bits in multilayer feedforward neural networks (MLFNN) of different probability distribution. The performance of the training was compared with and without clipping weights for MLFNN. We established and analyzed the relationships between inputs and outputs among bit resolution, network-layer number, and performance degradation of MLFNN which are based on statistical models on-chip and off-chip training.
Bussgang revisited: effect of quantization on signal to distortion plus noise ratio with non-Gaussian signals

Alister Burr,Abigail Elcock,Junbo Zhao

2024-08-24

Abstract:Quantization plays an important role in the physical layer (PHY) disaggregation which is fundamental to the Open Radio Access Network (O-RAN) architecture, since digitized signals must be transmitted over fronthaul connections. In this paper we explore the effect of quantization on PHY performance, drawing on the Bussgang decomposition and the implications of the Bussgang theorem and extending it to the case of non-Gaussian signals. We first prove several theorems regarding the signal to distortion plus noise ratio for a general non-linearity, applicable to both the Gaussian and the non-Gaussian case, showing that the decomposition can be applied to the non-Gaussian case, but that formulae previously introduced should be amended. We then apply these results to the non-linearity created by quantization, both for Gaussian and non-Gaussian signal distributions, and give numerical results derived from both theory and simulation.

Information Theory,Signal Processing
Asymptotic order of the quantization error for a class of self-similar measures with overlaps

Sanguo Zhu

2024-05-05

Abstract:Let $\{f_i\}_{i=1}^N$ be a set of equi-contractive similitudes on $\mathbb{R}^1$ satisfying the finite-type condition. We study the asymptotic quantization error for self-similar measures $\mu$ associated with $\{f_i\}_{i=1}^N$ and a positive probability vector. With a verifiable assumption, we prove that the upper and lower quantization coefficient for $\mu$ are both bounded away from zero and infinity. This can be regarded as an extension of Graf and Luschgy's result on self-similar measures with the open set condition. Our result is applicable to a significant class of self-similar measures with overlaps, including Erdös measure, the $3$-fold convolution of the classical Cantor measure and the self-similar measures on some $\lambda$-Cantor sets.

Functional Analysis,Metric Geometry
On Transmission Model for Massive MIMO under Low-Resolution Output Quantization

Bin Li,Ning Liang,Wenyi Zhang

DOI: https://doi.org/10.1109/vtcspring.2017.8108318

2017-01-01

Abstract:A general analytical framework based on generalized mutual information is applied to the analysis of massive multiple-input-multiple-output systems with low-resolution output quantization. For Gaussian codebook ensemble and nearestneighbor decoding rule, an equivalence relationship is established for general nonlinear transceiver distortion, that the effective signal-to-noise ratio based on the generalized mutual information is consistent with the heuristically derived signal-to-quantizationnoise ratio based on Bussgang theorem. Specializing to lowresolution output quantization, an extensively used approximate model called the additive quantization noise model is shown to be inconsistent with the generalized mutual information analysis, but this inconsistency can be remedied by taking into account the correlation within the quantization noise vector.
The Performance of PCM Quantization Under Tight Frame Representations

Yang Wang,Zhiqiang Xu

DOI: https://doi.org/10.48550/arXiv.1103.3846

2011-03-20

Abstract:In this paper, we study the performance of the PCM scheme with linear quantization rule for quantizing finite unit-norm tight frame expansions for $\R^d$ and derive the PCM quantization error without the White Noise Hypothesis. We prove that for the class of unit norm tight frames derived from uniform frame paths the quantization error has an upper bound of $O(\delta^{3/2})$ regardless of the frame redundancy. This is achieved using some of the techniques developed by Güntürk in his study of Sigma-Delta quantization. Using tools of harmonic analysis we show that this upper bound is sharp for $d=2$. A consequence of this result is that, unlike with Sigma-Delta quantization, the error for PCM quantization in general does not diminish to zero as one increases the frame redundancy. We extend the result to high dimension and show that the PCM quantization error has an upper bound $O(\delta^{(d+1)/2})$ for asymptopitcally equidistributed unit-norm tight frame of $\R^{d}$.

Numerical Analysis,Information Theory,Functional Analysis
On Constrained Randomized Quantization

Emrah Akyol,Kenneth Rose

DOI: https://doi.org/10.1109/TSP.2013.2261296

2012-06-14

Abstract:Randomized (dithered) quantization is a method capable of achieving white reconstruction error independent of the source. Dithered quantizers have traditionally been considered within their natural setting of uniform quantization. In this paper we extend conventional dithered quantization to nonuniform quantization, via a subterfage: dithering is performed in the companded domain. Closed form necessary conditions for optimality of the compressor and expander mappings are derived for both fixed and variable rate randomized quantization. Numerically, mappings are optimized by iteratively imposing these necessary conditions. The framework is extended to include an explicit constraint that deterministic or randomized quantizers yield reconstruction error that is uncorrelated with the source. Surprising theoretical results show direct and simple connection between the optimal constrained quantizers and their unconstrained counterparts. Numerical results for the Gaussian source provide strong evidence that the proposed constrained randomized quantizer outperforms the conventional dithered quantizer, as well as the constrained deterministic quantizer. Moreover, the proposed constrained quantizer renders the reconstruction error nearly white. In the second part of the paper, we investigate whether uncorrelated reconstruction error requires random coding to achieve asymptotic optimality. We show that for a Gaussian source, the optimal vector quantizer of asymptotically high dimension whose quantization error is uncorrelated with the source, is indeed random. Thus, random encoding in this setting of rate-distortion theory, is not merely a tool to characterize performance bounds, but a required property of quantizers that approach such bounds.

Information Theory
Quantized H∞ Filtering for Discrete-Time Systems over Fading Channels.

Wei Chen,Yuanyuan Zou,Nan Xiao,Yugang Niu

DOI: https://doi.org/10.1177/0142331217714862

IF: 2.146

2017-01-01

Transactions of the Institute of Measurement and Control

Abstract:This paper addresses the problem of quantized [Formula: see text] filtering for multi-output discrete-time systems over independent identically distributed (i.i.d.) fading channels and Markov fading channels, respectively. The measurement outputs are quantized by a logarithmic quantizer, and then transmitted to the filter over fading channels. For the i.i.d. fading channels, the stochastic multiplicative noise form is used to model the unreliable communication environment. For the Markov fading channels, a set of Markov channel state processes is introduced to model time-varying fading channels, which characterizes various configurations of the physical communication environment and/or different channel fading amplitudes. The sufficient condition for stochastic stability with a prescribed [Formula: see text] performance is obtained by using a Lyapunov method and matrix decoupling technique. The corresponding filter design casts into a convex optimization problem. Finally, simulation results are provided to illustrate the effectiveness of our results.

Quantization Errors of Uniformly Quantized Fgn and Fbm Signals.

Quantization Errors of fGn and fBm Signals

Parameter identifiability of quantized linear systems

Asymptotically Optimal One-Bit Quantizer Design for Weak-Signal Detection in Generalized Gaussian Noise and Lossy Binary Communication Channel.

Response of Quasi-Integrable and Non-Resonant Hamiltonian Systems to Fractional Gaussian Noise

Quantization Errors of Modulo Sigma-Delta Modulated ARMA Processes

Vector Quantization with Error Uniformly Distributed over an Arbitrary Set

Asymptotics of the quantization errors for some Markov-type measures with complete overlaps

Asymptotic local uniformity of the quantization error for Ahlfors-David probability measures

Quantum channel measurement with local quantum Bernoulli noises

Rejection-Sampled Universal Quantization for Smaller Quantization Errors

Lattice Quantization Noise Revisited.

Random Quantum Circuits Transform Local Noise into Global White Noise

The Effects Of Quantization On Multi-Layer Feedforward Neural Networks

The Quantization Effects of Different Probability Distribution on Multilayer Feedforward Neural Networks

Bussgang revisited: effect of quantization on signal to distortion plus noise ratio with non-Gaussian signals

Asymptotic order of the quantization error for a class of self-similar measures with overlaps

On Transmission Model for Massive MIMO under Low-Resolution Output Quantization

The Performance of PCM Quantization Under Tight Frame Representations

On Constrained Randomized Quantization

Quantized H∞ Filtering for Discrete-Time Systems over Fading Channels.