Non-asymptotic results for Cornish--Fisher expansions

V. V. Ulyanov,M. Aoshima,Y. Fujikoshi

DOI: https://doi.org/10.1007/s10958-016-3036-2

2016-04-03

Abstract:We get the computable error bounds for generalized Cornish-Fisher expansions for quantiles of statistics provided that the computable error bounds for Edgeworth-Chebyshev type expansions for distributions of these statistics are known. The results are illustrated by examples.

Statistics Theory

What problem does this paper attempt to address?

On Error Bounds for Orthogonal Polynomial Expansions and Gauss-Type Quadrature

Shuhuang Xiang

DOI: https://doi.org/10.1137/110820841

IF: 3.039

2012-01-01

SIAM Journal on Numerical Analysis

Abstract:This paper presents new asymptotics on the coefficients of f(x) expanded in forms of ultraspherical or Jacobi polynomial series, which imply the rate of the decay of the coefficients and derive the truncated error bounds. Moreover, we show that the Chebyshev coefficient alpha(n) decays a factor of root n faster than the Legendre coefficient u(n). By using the Chebyshev expansion for f(x) of finite regularity, we give new error bounds for a Gauss-type quadrature and present the aliasing error between the coefficients, which shows the equal accuracy of these quadratures for nonanalytic functions.
Asymptotic Expansions in the CLT in Free Probability

G. P. Chistyakov,F. Götze

DOI: https://doi.org/10.48550/arXiv.1109.4844

2011-12-22

Abstract:We prove Edgeworth type expansions for distribution functions of sums of free random variables under minimal moment conditions. The proofs are based on the analytic definition of free convolution. We apply these results to the expansion of densities to derive expansions for the free entropic distance of sums to the Wigner law.

Probability
Edgeworth approximations for distributions of symmetric statistics

Friedrich Götze,Mindaugas Bloznelis

DOI: https://doi.org/10.48550/arXiv.2102.03589

2021-02-06

Abstract:We study the distribution of a general class of asymptoticallylinear statistics which are symmetric functions of $N$ independent observations. The distribution functions of these statistics are approximated by an Edgeworth expansion with a remainder of order $o(N^{-1})$. The Edgeworth expansion is based on Hoeffding's decomposition which provides a stochastic expansion into a linear part, a quadratic part as well as smaller higher order parts. The validity of this Edgeworth expansion is proved under Cramér's condition on the linear part, moment assumptions for all parts of the statistic and an optimal dimensionality requirement for the non linear part.

Statistics Theory,Probability
On asymptotics of eigenvectors of large sample covariance matrix

Z. D. Bai,B. Q. Miao,G. M. Pan

DOI: https://doi.org/10.1214/009117906000001079

2007-01-01

Abstract:Let {X-ij}, i, j = .... be a double array of i.i.d. complex random variables with EX11 =0, E vertical bar X-11 vertical bar(2) = 1 and E vertical bar X-11 vertical bar(4) < infinity, and let A(n) = 1/N T-n(1/2) X-n (XnTn1/2)-T-*, where T-n(1/2) is the square root of a nonnegative definite matrix T-n and X-n is the n x N matrix of the upper-left corner of the double array. The matrix A(n) can be considered as a sample covariance matrix of an i.i.d. sample from a population with mean zero and covariance matrix T-n, or as a multivariate F matrix if T-n is the inverse of another sample covariance matrix. To investigate the limiting behavior of the eigenvectors of A(n), a new form of empirical spectral distribution is defined with weights defined by eigenvectors and it is then shown that this has the same limiting spectral distribution as the empirical spectral distribution defined by equal weights. Moreover, if {X-ij} and T-n are either real or complex and some additional moment assumptions are made then linear spectral statistics defined by the eigenvectors of A(n) are proved to have Gaussian limits, which suggests that the eigenvector matrix of A(n) is nearly Haar distributed when T-n is a multiple of the identity matrix, an easy consequence for a Wishart matrix.
New Weak Error bounds and expansions for Optimal Quantization

Vincent Lemaire,Thibaut Montes,Gilles Pagès

DOI: https://doi.org/10.1016/j.cam.2019.112670

2020-05-01

Abstract:We propose new weak error bounds and expansion in dimension one for optimal quantization-based cubature formula for different classes of functions, such that piecewise affine functions, Lipschitz convex functions or differentiable function with piecewise-defined locally Lipschitz or $\alpha$-Hölder derivatives. This new results rest on the local behaviors of optimal quantizers, the $L^r$-$L^s$ distribution mismatch problem and Zador's Theorem. This new expansion supports the definition of a Richardson-Romberg extrapolation yielding a better rate of convergence for the cubature formula. An extension of this expansion is then proposed in higher dimension for the first time. We then propose a novel variance reduction method for Monte Carlo estimators, based on one dimensional optimal quantizers.

Probability
Quantile function expansion using regularly varying functions

Thomas Fung,Eugene Seneta

DOI: https://doi.org/10.48550/arXiv.1705.09494

2017-08-09

Abstract:We present a simple result that allows us to evaluate the asymptotic order of the remainder of a partial asymptotic expansion of the quantile function $h(u)$ as $u\to 0^+$ or $1^-$. This is focussed on important univariate distributions when $h(\cdot)$ has no simple closed form, with a view to assessing asymptotic rate of decay to zero of tail dependence in the context of bivariate copulas. The Introduction motivates the study in terms of the standard Normal. The Normal, Skew-Normal and Gamma are used as initial examples. Finally, we discuss approximation to the lower quantile of the Variance-Gamma and Skew-Slash distributions.

Statistics Theory
Finite-sample expansions for the optimal error probability in asymmetric binary hypothesis testing

Valentinian Lungu,Ioannis Kontoyiannis

2024-05-29

Abstract:The problem of binary hypothesis testing between two probability measures is considered. New sharp bounds are derived for the best achievable error probability of such tests based on independent and identically distributed observations. Specifically, the asymmetric version of the problem is examined, where different requirements are placed on the two error probabilities. Accurate nonasymptotic expansions with explicit constants are obtained for the error probability, using tools from large deviations and Gaussian approximation. Examples are shown indicating that, in the asymmetric regime, the approximations suggested by the new bounds are significantly more accurate than the approximations provided by either of the two main earlier approaches -- normal approximation and error exponents.

Information Theory,Statistics Theory
Edgeworth expansion for the pre-averaging estimator

Mark Podolskij,Bezirgen Veliyev,Nakahiro Yoshida

DOI: https://doi.org/10.48550/arXiv.1512.04716

2015-12-15

Abstract:In this paper, we study the Edgeworth expansion for a pre-averaging estimator of quadratic variation in the framework of continuous diffusion models observed with noise. More specifically, we obtain a second order expansion for the joint density of the estimators of quadratic variation and its asymptotic variance. Our approach is based on martingale embedding, Malliavin calculus and stable central limit theorems for continuous diffusions. Moreover, we derive the density expansion for the studentized statistic, which might be applied to construct asymptotic confidence regions.

Statistics Theory,Probability,Statistical Finance
Generalized Bhattacharyya and Chernoff upper bounds on Bayes error using quasi-arithmetic means

Frank Nielsen

DOI: https://doi.org/10.1016/j.patrec.2014.01.002

2014-01-20

Abstract:Bayesian classification labels observations based on given prior information, namely class-a priori and class-conditional probabilities. Bayes' risk is the minimum expected classification cost that is achieved by the Bayes' test, the optimal decision rule. When no cost incurs for correct classification and unit cost is charged for misclassification, Bayes' test reduces to the maximum a posteriori decision rule, and Bayes risk simplifies to Bayes' error, the probability of error. Since calculating this probability of error is often intractable, several techniques have been devised to bound it with closed-form formula, introducing thereby measures of similarity and divergence between distributions like the Bhattacharyya coefficient and its associated Bhattacharyya distance. The Bhattacharyya upper bound can further be tightened using the Chernoff information that relies on the notion of best error exponent. In this paper, we first express Bayes' risk using the total variation distance on scaled distributions. We then elucidate and extend the Bhattacharyya and the Chernoff upper bound mechanisms using generalized weighted means. We provide as a byproduct novel notions of statistical divergences and affinity coefficients. We illustrate our technique by deriving new upper bounds for the univariate Cauchy and the multivariate $t$-distributions, and show experimentally that those bounds are not too distant to the computationally intractable Bayes' error.

Computer Vision and Pattern Recognition,Information Theory
Asymptotics on Laguerre or Hermite polynomial expansions and their applications in Gauss quadrature

Shuhuang Xiang

DOI: https://doi.org/10.1016/j.jmaa.2012.03.056

IF: 1.417

2012-01-01

Journal of Mathematical Analysis and Applications

Abstract:In this paper, we present asymptotic analysis on the coefficients of functions expanded in forms of Laguerre or Hermite polynomial series, which shows the decay of the coefficients and derives new error bounds on the truncated series. Moreover, by applying the asymptotics, new estimates on the errors for Gauss–Laguerre, Radau–Laguerre and Gauss–Hermite quadrature are deduced. These results show that Gauss–Laguerre-type and Gauss-Hermite-type quadratures are nearly of same convergence rates.
On Some Tests of the Covariance Matrix under General Conditions

Arjun K. Gupta,Jin Xu

DOI: https://doi.org/10.1007/s10463-005-0010-z

2006-01-01

Annals of the Institute of Statistical Mathematics

Abstract:We consider the problem of testing the hypothesis about the covariance matrix of random vectors under the assumptions that the underlying distributions are nonnormal and the sample size is moderate. The asymptotic expansions of the null distributions are obtained up to n −1/2 . It is found that in most cases the null statistics are distributed as a mixture of independent chi-square random variables with degree of freedom one (up to n −1/2 ) and the coefficients of the mixtures are functions of the fourth cumulants of the original random variables. We also provide a general method to approximate such distributions based on a normalization transformation.
Non-asymptotic approximations for Pearson's chi-square statistic and its application to confidence intervals for strictly convex functions of the probability weights of discrete distributions

Eric Bax,Frédéric Ouimet

2023-09-05

Abstract:In this paper, we develop a non-asymptotic local normal approximation for multinomial probabilities. First, we use it to find non-asymptotic total variation bounds between the measures induced by uniformly jittered multinomials and the multivariate normals with the same means and covariances. From the total variation bounds, we also derive a comparison of the cumulative distribution functions and quantile coupling inequalities between Pearson's chi-square statistic (written as the normalized quadratic form of a multinomial vector) and its multivariate normal analogue. We apply our results to find confidence intervals for the negative entropy of discrete distributions. Our method can be applied more generally to find confidence intervals for strictly convex functions of the weights of discrete distributions.

Statistics Theory,Probability,Machine Learning
Improved concentration of Laguerre and Jacobi ensembles

Yichen Huang,Aram W. Harrow

DOI: https://doi.org/10.1137/23M1545343

2023-11-29

Abstract:We consider the asymptotic limits where certain parameters in the definitions of the Laguerre and Jacobi ensembles diverge. In these limits, Dette, Imhof, and Nagel proved that up to a linear transformation, the joint probability distributions of the ensembles become more and more concentrated around the zeros of the Laguerre and Jacobi polynomials, respectively. In this paper, we improve the concentration bounds. Our proofs are similar to those in the original references, but the error analysis is improved and arguably simpler. For the first and second moments of the Jacobi ensemble, we further improve the concentration bounds implied by our aforementioned results.

Probability,Mathematical Physics
Asymptotics for conformal inference

Ulysse Gazin

2024-09-18

Abstract:Conformal inference is a versatile tool for building prediction sets in regression or classification. In this paper, we consider the false coverage proportion (FCP) in a transductive setting with a calibration sample of n points and a test sample of m points. We identify the exact, distribution-free, asymptotic distribution of the FCP when both n and m tend to infinity. This shows in particular that FCP control can be achieved by using the well-known Kolmogorov distribution, and puts forward that the asymptotic variance is decreasing in the ratio n/m. We then provide a number of extensions by considering the novelty detection problem, weighted conformal inference and distribution shift between the calibration sample and the test sample. In particular, our asymptotical results allow to accurately quantify the asymptotical behavior of the errors when weighted conformal inference is used.

Statistics Theory
Asymptotic order of the quantization error for a class of self-similar measures with overlaps

Sanguo Zhu

2024-05-05

Abstract:Let $\{f_i\}_{i=1}^N$ be a set of equi-contractive similitudes on $\mathbb{R}^1$ satisfying the finite-type condition. We study the asymptotic quantization error for self-similar measures $\mu$ associated with $\{f_i\}_{i=1}^N$ and a positive probability vector. With a verifiable assumption, we prove that the upper and lower quantization coefficient for $\mu$ are both bounded away from zero and infinity. This can be regarded as an extension of Graf and Luschgy's result on self-similar measures with the open set condition. Our result is applicable to a significant class of self-similar measures with overlaps, including Erdös measure, the $3$-fold convolution of the classical Cantor measure and the self-similar measures on some $\lambda$-Cantor sets.

Functional Analysis,Metric Geometry
POINTWISE ERROR ESTIMATES AND LOCAL SUPERCONVERGENCE OF JACOBI EXPANSIONS

Shuhuang Xiang,Desong Kong,Guidong Liu,Li-Lian Wang

DOI: https://doi.org/10.1090/mcom/3835

IF: 2.118

2023-01-01

Mathematics of Computation

Abstract:As one myth of polynomial interpolation and quadrature, Trefethen [Math. Today (Southend-on-Sea) 47 (2011), pp. 184–188] revealed that the Chebyshev interpolation of | x − a | |x-a| (with | a | > 1 |a|>1 ) at the Clenshaw-Curtis points exhibited a much smaller error than the best polynomial approximation (in the maximum norm) in about 95 95% range of [ − 1 , 1 ] [-1,1] except for a small neighbourhood near the singular point x = a . x=a. In this paper, we rigorously show that the Jacobi expansion for a more general class of Φ \Phi -functions also enjoys such a local convergence behaviour. Our assertion draws on the pointwise error estimate using the reproducing kernel of Jacobi polynomials and the Hilb-type formula on the asymptotic of the Bessel transforms. We also study the local superconvergence and show the gain in order and the subregions it occurs. As a by-product of this new argument, the undesired log ⁡ n \log n -factor in the pointwise error estimate for the Legendre expansion recently stated in Babus̆ka and Hakula [Comput. Methods Appl. Mech Engrg. 345 (2019), pp. 748–773] can be removed. Finally, all these estimates are extended to the functions with boundary singularities. We provide ample numerical evidences to demonstrate the optimality and sharpness of the estimates.
Asymptotic Expansions of the Distributions of Some Test Statistics in Generalized Linear Models

Jin Xu,Arjun K. Gupta

DOI: https://doi.org/10.1080/02331880601013767

IF: 2.346

2007-01-01

Statistics

Abstract:The asymptotic expansions of the distributions of three statistics, namely, the likelihood ratio, Wald and Rao's score statistics, are obtained for testing a subset of parameters in the generalized linear models. The asymptotic expansions are given in closed forms up to n(-1) in the null case and up to n(-1/2) in the nonnull case under a sequence of Pitman alternatives. It is found that the power of Wald and Rao's score tests are same up to n(-1/2). Numerical examples are presented to illustrate the performance of the asymptotic null distributions.
Two New Tests for Equality of Several Covariance Functions

Jia Guo,Jin-Ting Zhang

DOI: https://doi.org/10.48550/arXiv.1609.04234

2016-09-14

Methodology

Abstract:In this paper, we propose two new tests for testing the equality of the covariance functions of several functional populations, namely a quasi GPF test and a quasi $F_{\max}$ test. The asymptotic random expressions of the two tests under the null hypothesis are derived. We show that the asymptotic null distribution of the quasi GPF test is a chi-squared-type mixture whose distribution can be well approximated by a simple scaled chi-squared distribution. We also adopt a random permutation method for approximating the null distributions of the quasi GPF and $F_{\max}$ tests. The random permutation method is applicable for both large and finite sample sizes. The asymptotic distributions of the two tests under a local alternative are investigated and they are shown to be root-n consistent. Simulation studies are presented to demonstrate the finite-sample performance of the new tests against three existing tests. They show that our new tests are more powerful than the three existing tests when the covariance functions at different time points have different scales. An illustrative example is also presented.
Higher order asymptotic expansions for the convection-diffusion equation in the Fujita-subcritical case

Ryunosuke Kusaba

2024-11-03

Abstract:This paper is devoted to the asymptotic behavior of global solutions to the convection-diffusion equation in the Fujita-subcritical case. We improve the result by Zuazua (1993) and establish higher order asymptotic expansions with decay estimates of the remainders. We also discuss the optimality for the decay rates of the remainders.

Analysis of PDEs
Poisson and Compound Poisson Approximations in a Nonconventional Setup

Yuri Kifer,Ariel Rapaport

DOI: https://doi.org/10.48550/arXiv.1211.5238

2012-12-11

Abstract:We show that for all $\psi$-mixing shifts distributions of the numbers of multiple recurrencies to shrinking cylindrical neighborhoods of all points are close either to Poisson or to compound Poisson distributions. We also describe completely the asymptotic behavior of these distributions.

Probability,Dynamical Systems

Non-asymptotic results for Cornish--Fisher expansions

On Error Bounds for Orthogonal Polynomial Expansions and Gauss-Type Quadrature

Asymptotic Expansions in the CLT in Free Probability

Edgeworth approximations for distributions of symmetric statistics

On asymptotics of eigenvectors of large sample covariance matrix

New Weak Error bounds and expansions for Optimal Quantization

Quantile function expansion using regularly varying functions

Finite-sample expansions for the optimal error probability in asymmetric binary hypothesis testing

Edgeworth expansion for the pre-averaging estimator

Generalized Bhattacharyya and Chernoff upper bounds on Bayes error using quasi-arithmetic means

Asymptotics on Laguerre or Hermite polynomial expansions and their applications in Gauss quadrature

On Some Tests of the Covariance Matrix under General Conditions

Non-asymptotic approximations for Pearson's chi-square statistic and its application to confidence intervals for strictly convex functions of the probability weights of discrete distributions

Improved concentration of Laguerre and Jacobi ensembles

Asymptotics for conformal inference

Asymptotic order of the quantization error for a class of self-similar measures with overlaps

POINTWISE ERROR ESTIMATES AND LOCAL SUPERCONVERGENCE OF JACOBI EXPANSIONS

Asymptotic Expansions of the Distributions of Some Test Statistics in Generalized Linear Models

Two New Tests for Equality of Several Covariance Functions

Higher order asymptotic expansions for the convection-diffusion equation in the Fujita-subcritical case

Poisson and Compound Poisson Approximations in a Nonconventional Setup