Quantization Errors of fGn and fBm Signals

Zhiheng Li,Li Li,Yudong Chen,Yi Zhang

DOI: https://doi.org/10.1109/LSP.2009.2030115

2009-05-28

Abstract:In this Letter, we show that under the assumption of high resolution, the quantization errors of fGn and fBm signals with uniform quantizer can be treated as uncorrelated white noises.

Information Theory

What problem does this paper attempt to address?

Quantization Errors of Uniformly Quantized Fgn and Fbm Signals.

Zhiheng Li,Yudong Chen,Li,Yi Zhang

DOI: https://doi.org/10.1109/lsp.2009.2030115

2009-01-01

IEEE Signal Processing Letters

Abstract:In this letter, we show that under the assumption of high resolution, the quantization errors of fGn and fBm signals with uniform quantizer can be treated as uncorrelated white noises.
Asymptotically Optimal One-Bit Quantizer Design for Weak-Signal Detection in Generalized Gaussian Noise and Lossy Binary Communication Channel.

Guanyu Wang,Jiang Zhu,Zhiwei Xu

DOI: https://doi.org/10.1016/j.sigpro.2018.09.005

IF: 4.729

2018-01-01

Signal Processing

Abstract:In this paper, quantizer design for weak-signal detection under arbitrary binary channel in generalized Gaussian noise is studied. Since the performances of the generalized likelihood ratio test (GLRT) and Rao test are asymptotically characterized by the noncentral chi-squared probability density function (PDF), the threshold design problem can be formulated as a noncentrality parameter maximization problem. The theoretical property of the noncentrality parameter with respect to the threshold is investigated, and the optimal threshold is shown to be found in polynomial time with appropriate numerical algorithm and proper initializations. In certain cases, the optimal threshold is proved to be zero. Finally, numerical experiments are conducted to substantiate the theoretical analysis.
Response of Quasi-Integrable and Non-Resonant Hamiltonian Systems to Fractional Gaussian Noise

Qiangfeng Lu,Weiqiu Zhu,Maolin Deng

DOI: https://doi.org/10.1109/access.2020.2987822

IF: 3.9

2020-01-01

IEEE Access

Abstract:The main difficulty of analyzing the response of nonlinear dynamical systems to fractional Gaussian noise (fGn) is the non-Markov property and non-usefulness of diffusion process theory. Currently, only numerical simulation can be applied to obtain the response of nonlinear systems to fGn. In the present paper, noting the rather flat property of the fGn power spectral density (PSD) in most part of frequency band, the stochastic averaging method for quasi-integrable Hamiltonian systems under wide-band noise excitation is applied to predict the response of quasi-integrable and non-resonant Hamiltonian systems to fGn. By using this method, the averaged Itô stochastic differential equations (SDEs) are established and the probability density function (PDF) of system response can be obtained from solving the corresponding Fokker-Planck-Kolmogorov (FPK) equation. All of the statistics of system response are then obtained from the PDF analytically and verified through the comparison with the simulation results.
Quantization Errors of Modulo Sigma-Delta Modulated ARMA Processes

Li Li,Yudong Chen

DOI: https://doi.org/10.1109/ChinaSIP.2013.6625303

2014-06-07

Abstract:In this paper, we study the quantization errors of modulo sigma-delta modulated finite, asymptotically-infinite, infinite causal stable ARMA processes. We prove that the normalized quantization error can be taken as a uniformly distributed white noise for all the cases. Moreover, we find that this nice property is guaranteed by two different mechanisms: the high-enough quantization resolution \cite{Bennett1948}-\cite{WidrowKollar2008} and the asymptotic convergence of quantization errors for some quasi-stationary processes \cite{ChouGray1991}-\cite{LiChenLiZhang2009}, for different cases. But the assumption of the smooth density of the sampled random processes is needed in all the cases.

Information Theory,Networking and Internet Architecture
Asymptotics of the quantization errors for some Markov-type measures with complete overlaps

Sanguo Zhu

2023-07-11

Abstract:Let $\mathcal{G}$ be a directed graph with vertices $1,2,\ldots, 2N$. Let $\mathcal{T}=(T_{i,j})_{(i,j)\in\mathcal{G}}$ be a family of contractive similitudes. For every $1\leq i\leq N$, let $i^+:=i+N$. For $1\leq i,j\leq N$, we define $\mathcal{M}_{i,j}=\{(i,j),(i,j^+),(i^+,j),(i^+,j^+)\}\cap\mathcal{G}$. We assume that $T_{\widetilde{i},\widetilde{j}}=T_{i,j}$ for every $(\widetilde{i},\widetilde{j})\in \mathcal{M}_{i,j}$. Let $K$ denote the Mauldin-Williams fractal determined by $\mathcal{T}$. Let $\chi=(\chi_i)_{i=1}^{2N}$ be a positive probability vector and $P$ a row-stochastic matrix which serves as an incidence matrix for $\mathcal{G}$. We denote by $\nu$ the Markov-type measure associated with $\chi$ and $P$. Let $\Omega=\{1,\ldots,2N\}$ and $G_\infty=\{\sigma\in\Omega^{\mathbb{N}}:(\sigma_i,\sigma_{i+1})\in\mathcal{G}, \;i\geq 1\}$. Let $\pi$ be the natural projection from $G_\infty$ to $K$ and $\mu=\nu\circ\pi^{-1}$. We consider the following two cases: 1. $\mathcal{G}$ has two strongly connected components consisting of $N$ vertices; 2. $\mathcal{G}$ is strongly connected. With some assumptions for $\mathcal{G}$ and $\mathcal{T}$, for case 1, we determine the exact value $s_r$ of the quantization dimension $D_r(\mu)$ for $\mu$ and prove that the $s_r$-dimensional lower quantization coefficient is always positive, but the upper one can be infinite; we establish a necessary and sufficient condition for the upper quantization coefficient for $\mu$ to be finite; for case 2, we determine $D_r(\mu)$ in terms of a pressure-like function and prove that $D_r(\mu)$-dimensional upper and lower quantization coefficient are both positive and finite.

Functional Analysis,Information Theory
Quantum channel measurement with local quantum Bernoulli noises

Qi Han,Yanan Han,Yaxin Kou,Ning Bai

DOI: https://doi.org/10.1038/s41598-022-17268-y

2022-07-28

Abstract:As an important stochastic process, quantum Bernoulli noises has a very important physical background and is an important research object in the field of quantum information. In this paper, we review local quantum Bernoulli noises and local quantum mutual entropy, then introduce quantum channel measurement with local quantum Bernoulli noises. On this basis, we give the channel structure between two systems, and prove the completely positivity of this quantum channel. We also give a channel application on the local quantum mutual entropy.
Revisiting fractional Gaussian noise

Ming Li,Xichao Sun,Xi Xiao

DOI: https://doi.org/10.1016/j.physa.2018.09.008

2019-01-01

Abstract:The contributions given in this article are mainly in two folds with regard to the fractional Gaussian noise of the Weyl type. The first one is to present a complete form of fGn, which is taken as the output of a fractional-order filter driven by white noise. The second is to propose the analytic expressions of the impulse response function and the frequency transfer function of that fractional-order filter. We also give an expression of the fractional Brownian motion of the Weyl type as a consequence of the present fGn. Besides, we suggest that the statistical dependences of fGn may be described based on the frequency transfer function or the impulse response function of the fractional-order filter.
Lattice Quantization Noise Revisited.

Cong Ling,Lu Gan

DOI: https://doi.org/10.1109/itw.2013.6691297

2013-01-01

Abstract:Dithered quantization is widely used in signal processing and coding due to its many desirable properties in theory and in practice. In this paper, we show that dither is unnecessary for Gaussian sources when the flatness factor of the quantization lattice is small. This means that the quantization noise behaves much like that in dithered quantization. In particular, it tends to be uniformly distributed over any fundamental region of the lattice and be uncorrelated with the signal; further, for optimum lattice quantizers, it approaches the rate-distortion bound of Gaussian sources with minimum mean-square error (MMSE) estimation.
Asymptotic local uniformity of the quantization error for Ahlfors-David probability measures

Sanguo Zhu

DOI: https://doi.org/10.48550/arXiv.1708.07657

2018-02-26

Abstract:Let $\mu$ be an Ahlfors-David probability measure on $\mathbb{R}^q$, namely, there exist some constants $s_0>0$ and $\epsilon_0,C_1,C_2>0$ such that \[ C_1\epsilon^{s_0}\leq\mu(B(x,\epsilon))\leq C_2\epsilon^{s_0},\;\epsilon\in(0,\epsilon_0),\;x\in{\rm supp}(\mu). \] For $n\geq 1$, let $\alpha_n$ be an $n$-optimal set for $\mu$ of order $r$ and $(P_a(\alpha_n))_{a\in\alpha_n}$ an arbitrary Voronoi partition with respect to $\alpha_n$. The $n$th quantization error $e_{n,r}(\mu)$ for $\mu$ of order $r$ is given by $e^r_{n,r}(\mu):=\int d(x,\alpha_n)^rd\mu(x)$. Write \[ I_a(\alpha,\mu):=\int_{P_a(\alpha_n)}d(x,\alpha_n)^rd\mu(x),\;a\in\alpha_n. \] We prove that, $\underline{J}(\alpha_n,\mu):=\min_{a\in\alpha_n}I_a(\alpha,\mu)$, $\overline{J}(\alpha_n,\mu):=\max_{a\in\alpha_n}I_a(\alpha,\mu)$ and the error difference $e^r_{n,r}(\mu)-e^r_{n+1,r}(\mu)$ are of the same order as $\frac{1}{n}e^r_{n,r}(\mu)$. This, together with Graf and Luschgy's work, yields that all the above three quantities are of the same order as $n^{-(1+\frac{r}{s_0})}$.

Metric Geometry
Random Quantum Circuits Transform Local Noise into Global White Noise

Alexander M. Dalzell,Nicholas Hunter-Jones,Fernando G. S. L. Brandão

DOI: https://doi.org/10.1007/s00220-024-04958-z

IF: 2.361

2024-03-14

Communications in Mathematical Physics

Abstract:We study the distribution over measurement outcomes of noisy random quantum circuits in the regime of low fidelity, which corresponds to the setting where the computation experiences at least one gate-level error with probability close to one. We model noise by adding a pair of weak, unital, single-qubit noise channels after each two-qubit gate, and we show that for typical random circuit instances, correlations between the noisy output distribution and the corresponding noiseless output distribution shrink exponentially with the expected number of gate-level errors. Specifically, the linear cross-entropy benchmark F that measures this correlation behaves as , where is the probability of error per circuit location and s is the number of two-qubit gates. Furthermore, if the noise is incoherent—for example, depolarizing or dephasing noise—the total variation distance between the noisy output distribution and the uniform distribution decays at precisely the same rate. Consequently, the noisy output distribution can be approximated as . In other words, although at least one local error occurs with probability , the errors are scrambled by the random quantum circuit and can be treated as global white noise, contributing completely uniform output. Importantly, we upper bound the average total variation error in this approximation by . Thus, the "white-noise approximation" is meaningful when , a quadratically weaker condition than the requirement to maintain high fidelity. The bound applies if the circuit size satisfies , which corresponds to only logarithmic depth circuits, and if, additionally, the inverse error rate satisfies , which is needed to ensure errors are scrambled faster than F decays. The white-noise approximation is useful for salvaging the signal from a noisy quantum computation; for example, it was an underlying assumption in complexity-theoretic arguments that noisy random quantum circuits cannot be efficiently sampled classically, even when the fidelity is low. Our method is based on a map from second-moment quantities in random quantum circuits to expectation values of certain stochastic processes for which we compute upper and lower bounds.

physics, mathematical
Bussgang revisited: effect of quantization on signal to distortion plus noise ratio with non-Gaussian signals

Alister Burr,Abigail Elcock,Junbo Zhao

2024-08-24

Abstract:Quantization plays an important role in the physical layer (PHY) disaggregation which is fundamental to the Open Radio Access Network (O-RAN) architecture, since digitized signals must be transmitted over fronthaul connections. In this paper we explore the effect of quantization on PHY performance, drawing on the Bussgang decomposition and the implications of the Bussgang theorem and extending it to the case of non-Gaussian signals. We first prove several theorems regarding the signal to distortion plus noise ratio for a general non-linearity, applicable to both the Gaussian and the non-Gaussian case, showing that the decomposition can be applied to the non-Gaussian case, but that formulae previously introduced should be amended. We then apply these results to the non-linearity created by quantization, both for Gaussian and non-Gaussian signal distributions, and give numerical results derived from both theory and simulation.

Information Theory,Signal Processing
On Transmission Model for Massive MIMO under Low-Resolution Output Quantization

Bin Li,Ning Liang,Wenyi Zhang

DOI: https://doi.org/10.1109/vtcspring.2017.8108318

2017-01-01

Abstract:A general analytical framework based on generalized mutual information is applied to the analysis of massive multiple-input-multiple-output systems with low-resolution output quantization. For Gaussian codebook ensemble and nearestneighbor decoding rule, an equivalence relationship is established for general nonlinear transceiver distortion, that the effective signal-to-noise ratio based on the generalized mutual information is consistent with the heuristically derived signal-to-quantizationnoise ratio based on Bussgang theorem. Specializing to lowresolution output quantization, an extensively used approximate model called the additive quantization noise model is shown to be inconsistent with the generalized mutual information analysis, but this inconsistency can be remedied by taking into account the correlation within the quantization noise vector.
Some Results on Q -Difference Equations

Junchao Zhang,Gang Wang,Junjie Chen,Rongxiang Zhao

DOI: https://doi.org/10.1186/1687-1847-2012-191

2012-01-01

Advances in Difference Equations

Abstract:In this paper, we consider the q-difference analogue of the Clunie theorem. We obtain there is no zero-order entire solution of fn(z)+(∇qf(z))n=1Open image in new window when n≥2Open image in new window; there is no zero-order transcendental entire solution of fn(z)+P(z)(∇qf(z))m=Q(z)Open image in new window when n>m≥0Open image in new window; and the equation fn+P(z)∇qf(z)=h(z)Open image in new window has at most one zero-order transcendental entire solution f if f is not the solution of ∇qf(z)=0Open image in new window, when n≥4Open image in new window.
Rejection-Sampled Universal Quantization for Smaller Quantization Errors

Chih Wei Ling,Cheuk Ting Li

2024-02-05

Abstract:We construct a randomized vector quantizer which has a smaller maximum error compared to all known lattice quantizers with the same entropy for dimensions 5, 6, ..., 48, and also has a smaller mean squared error compared to known lattice quantizers with the same entropy for dimensions 35, ..., 48, in the high resolution limit. Moreover, our randomized quantizer has a desirable property that the quantization error is always uniform over the ball and independent of the input. Our construction is based on applying rejection sampling on universal quantization, which allows us to shape the error distribution to be any continuous distribution, not only uniform distributions over basic cells of a lattice as in conventional dithered quantization. We also characterize the high SNR limit of one-shot channel simulation for any additive noise channel under a mild assumption (e.g., the AWGN channel), up to an additive constant of 1.45 bits.

Information Theory,Signal Processing
Influence of quantization noise on harmonic analysis via interpolated fast Fourier transform

Chen Han-Xiao,Liu Hong-Xing,Wang Yuan-Qing

DOI: https://doi.org/10.3321/j.issn:0469-5097.2009.04.006

2009-01-01

Abstract:The interpolated fast Fourier transform(FFT) algorithm is widely used in accurately measuring the three parameters of a harmonic-frequency,amplitude and phase.Doubtlessly,the signal noise must deteriorate the measuring accuracy of the three harmonic parameters via interpolated FFT algorithm.Some literature has discussed the influence of white noises on the estimation of the harmonic parameters via interpolated FFT,but no paper is related to the influence of the A/D(analog-to-digital) quantization noise on the estimation by using interpolated FFT.Firstly,this paper summarizes the harmonic measuring algorithm with the interpolated FFT algorithm.Subsequently,the characteristics of A/D quantization noise are discussed and studied,finding that the noise is not white.On the basis of this,the paper studies in detail the degree of the influence by A/D quantization noise on the measured results of the three harmonic parameters by using interpolated FFT.The computation model is given,and then a great deal of calculating is done.The results obtained are as follows:(1) the shorter the A/D digital code length,the more significant the influence of the quantization noise,and we should be careful when using 8 bit or shorter code longth;(2) the smaller the input signal amplitude compared with the maximum A/D input range,the more significant of the influence of the quantization noise.It is believed that the obtained results are helpful to the selection of A/D and modifying devices in circuit designs.
The Effects Of Quantization On Multi-Layer Feedforward Neural Networks

Minghu Jiang,Georges G. E. Gielen

DOI: https://doi.org/10.1142/S0218001403002514

IF: 1.261

2003-01-01

International Journal of Pattern Recognition and Artificial Intelligence

Abstract:In this paper we investigate the combined effect of quantization and clipping on multi-layer feedforward neural networks (MLFNN). Statistical models are used to analyze the effects of quantization in a digital implementation. We analyze the performance degradation caused as a function of the number of fixed-point and floating-point quantization bits in the MLFNN. To analyze a true nonlinear neuron, we adopt the uniform and normal probability distributions, compare the training performances with and without weight clipping, and derive in detail the effect of the quantization error on forward and backward propagation. No matter what distribution the initial weights comply with, the weights distribution will approximate a normal distribution for the training of floating-point or high-precision fixed-point quantization. Only when the number of quantization bits is very low, the weights distribution may cluster to +/-1 for the training with fixed-point quantization. We establish and analyze the relationships for a true nonlinear neuron between inputs and outputs bit resolution, the number of network layers and the performance degradation, based on statistical models of on-chip and off-chip training. Our experimental simulation results verify the presented theoretical analysis.
Asymptotic order of the quantization error for a class of self-similar measures with overlaps

Sanguo Zhu

2024-05-05

Abstract:Let $\{f_i\}_{i=1}^N$ be a set of equi-contractive similitudes on $\mathbb{R}^1$ satisfying the finite-type condition. We study the asymptotic quantization error for self-similar measures $\mu$ associated with $\{f_i\}_{i=1}^N$ and a positive probability vector. With a verifiable assumption, we prove that the upper and lower quantization coefficient for $\mu$ are both bounded away from zero and infinity. This can be regarded as an extension of Graf and Luschgy's result on self-similar measures with the open set condition. Our result is applicable to a significant class of self-similar measures with overlaps, including Erdös measure, the $3$-fold convolution of the classical Cantor measure and the self-similar measures on some $\lambda$-Cantor sets.

Functional Analysis,Metric Geometry
Influence of Noise on the Fidelity and the Entanglement Fidelity of States

LM Duan,GC Guo

DOI: https://doi.org/10.1088/1355-5111/9/6/008

1997-01-01

Abstract:The fidelity and the entanglement fidelity are two important quantities indescribing the transmission of quantum information through (possibly noisy) quantum channels. In this paper these two quantities are calculated for different kinds of state which are transmitted in noisy channels. A general equation is obtained for these fidelities. Some examples are given to illustrate the general result and possible applications of these results to quantum cryptography and teleportation via noisy channels are discussed.
Quantized H∞ Filtering for Discrete-Time Systems over Fading Channels.

Wei Chen,Yuanyuan Zou,Nan Xiao,Yugang Niu

DOI: https://doi.org/10.1177/0142331217714862

IF: 2.146

2017-01-01

Transactions of the Institute of Measurement and Control

Abstract:This paper addresses the problem of quantized [Formula: see text] filtering for multi-output discrete-time systems over independent identically distributed (i.i.d.) fading channels and Markov fading channels, respectively. The measurement outputs are quantized by a logarithmic quantizer, and then transmitted to the filter over fading channels. For the i.i.d. fading channels, the stochastic multiplicative noise form is used to model the unreliable communication environment. For the Markov fading channels, a set of Markov channel state processes is introduced to model time-varying fading channels, which characterizes various configurations of the physical communication environment and/or different channel fading amplitudes. The sufficient condition for stochastic stability with a prescribed [Formula: see text] performance is obtained by using a Lyapunov method and matrix decoupling technique. The corresponding filter design casts into a convex optimization problem. Finally, simulation results are provided to illustrate the effectiveness of our results.
The Quantization Effects of Different Probability Distribution on Multilayer Feedforward Neural Networks

MH Jiang,G Gielen,BX Deng,XF Tang,QQ Ruan,BZ Yuan

DOI: https://doi.org/10.1109/icosp.2002.1179999

2002-01-01

Abstract:A statistical model of quantization was used to analyze the effects of quantization in digital implementation, and the performance degradation caused by number of quantized bits in multilayer feedforward neural networks (MLFNN) of different probability distribution. The performance of the training was compared with and without clipping weights for MLFNN. We established and analyzed the relationships between inputs and outputs among bit resolution, network-layer number, and performance degradation of MLFNN which are based on statistical models on-chip and off-chip training.

Quantization Errors of fGn and fBm Signals

Quantization Errors of Uniformly Quantized Fgn and Fbm Signals.

Asymptotically Optimal One-Bit Quantizer Design for Weak-Signal Detection in Generalized Gaussian Noise and Lossy Binary Communication Channel.

Response of Quasi-Integrable and Non-Resonant Hamiltonian Systems to Fractional Gaussian Noise

Quantization Errors of Modulo Sigma-Delta Modulated ARMA Processes

Asymptotics of the quantization errors for some Markov-type measures with complete overlaps

Quantum channel measurement with local quantum Bernoulli noises

Revisiting fractional Gaussian noise

Lattice Quantization Noise Revisited.

Asymptotic local uniformity of the quantization error for Ahlfors-David probability measures

Random Quantum Circuits Transform Local Noise into Global White Noise

Bussgang revisited: effect of quantization on signal to distortion plus noise ratio with non-Gaussian signals

On Transmission Model for Massive MIMO under Low-Resolution Output Quantization

Some Results on Q -Difference Equations

Rejection-Sampled Universal Quantization for Smaller Quantization Errors

Influence of quantization noise on harmonic analysis via interpolated fast Fourier transform

The Effects Of Quantization On Multi-Layer Feedforward Neural Networks

Asymptotic order of the quantization error for a class of self-similar measures with overlaps

Influence of Noise on the Fidelity and the Entanglement Fidelity of States

Quantized H∞ Filtering for Discrete-Time Systems over Fading Channels.

The Quantization Effects of Different Probability Distribution on Multilayer Feedforward Neural Networks