The Geometry of Chi-Square Degrees of Freedom

James Bernhard

2023-05-18

Abstract:In this paper, we state and prove a simple geometric interpretation of the degrees of freedom of a chi-square distribution. The general geometric idea goes back at least to Fisher in the 1920s, but the exact result does not appear to have been explicitly stated or proved prior to this paper.

Other Statistics,Probability,Statistics Theory

What problem does this paper attempt to address?

The nonparametric Fisher geometry and the chi-square process density prior

Andrew Holbrook,Shiwei Lan,Jeffrey Streets,Babak Shahbaba

DOI: https://doi.org/10.48550/arXiv.1707.03117

2017-11-15

Abstract:It is well known that the Fisher information induces a Riemannian geometry on parametric families of probability density functions. Following recent work, we consider the nonparametric generalization of the Fisher geometry. The resulting nonparametric Fisher geometry is shown to be equivalent to a familiar, albeit infinite-dimensional, geometric object---the sphere. By shifting focus away from density functions and toward \emph{square-root} density functions, one may calculate theoretical quantities of interest with ease. More importantly, the sphere of square-root densities is much more computationally tractable. This insight leads to a novel Bayesian nonparametric density estimation model. We construct the $\chi^2$-process density prior by modeling the square-root density with a restricted Gaussian process prior. Inference over square-root densities is fast, and the model retains the flexibility characteristic of Bayesian nonparametric models. Finally, we formalize the relationship between spherical HMC in the infinite-dimensional limit and standard Riemannian HMC.

Methodology
Degrees of freedom in discrete geometry

Seramika Ariwahjoedi,Jusak Sali Kosasih,Carlo Rovelli,Freddy P. Zen

DOI: https://doi.org/10.48550/arXiv.1607.07963

2016-07-27

General Relativity and Quantum Cosmology

Abstract:Following recent developments in discrete gravity, we study geometrical variables (angles and forms) of simplices in the discrete geometry point of view. Some of our relatively new results include: new ways of writing a set of simplices using vectorial (differential form) and coordinate-free pictures, and a consistent procedure to couple particles of space, together with a method to calculate the degrees of freedom of the system of 'quanta' of space in the classical framework.
Random Triangle Theory with Geometry and Applications

Alan Edelman,Gilbert Strang

DOI: https://doi.org/10.48550/arXiv.1501.03053

2015-01-10

Abstract:What is the probability that a random triangle is acute? We explore this old question from a modern viewpoint, taking into account linear algebra, shape theory, numerical analysis, random matrix theory, the Hopf fibration, and much much more. One of the best distributions of random triangles takes all six vertex coordinates as independent standard Gaussians. Six can be reduced to four by translation of the center to $(0,0)$ or reformulation as a 2x2 matrix problem. In this note, we develop shape theory in its historical context for a wide audience. We hope to encourage other to look again (and differently) at triangles. We provide a new constructive proof, using the geometry of parallelians, of a central result of shape theory: Triangle shapes naturally fall on a hemisphere. We give several proofs of the key random result: that triangles are uniformly distributed when the normal distribution is transferred to the hemisphere. A new proof connects to the distribution of random condition numbers. Generalizing to higher dimensions, we obtain the "square root ellipticity statistic" of random matrix theory. Another proof connects the Hopf map to the SVD of 2 by 2 matrices. A new theorem describes three similar triangles hidden in the hemisphere. Many triangle properties are reformulated as matrix theorems, providing insight to both. This paper argues for a shift of viewpoint to the modern approaches of random matrix theory. As one example, we propose that the smallest singular value is an effective test for uniformity. New software is developed and applications are proposed.

History and Overview,Metric Geometry
Log-concavity and discrete degrees of freedom

Jacek Jakimiuk,Daniel Murawski,Piotr Nayar,Semen Słobodianiuk

DOI: https://doi.org/10.1016/j.disc.2024.114020

IF: 0.961

2024-04-13

Discrete Mathematics

Abstract:We develop the notion of discrete degrees of freedom of a log-concave sequence and use it to prove that geometric distribution minimises Rényi entropy of order infinity under fixed variance, among all discrete log-concave random variables in Z . We also show that the quantity P(X=EX) is maximised, among all ultra-log-concave random variables with fixed integral mean, for a Poisson distribution.

mathematics
On the product of correlated normal random variables and the noncentral chi-square difference distribution

Robert E. Gaunt

2024-08-08

Abstract:We represent the product of two correlated normal random variables, and more generally the sum of independent copies of such random variables, as a difference of two independent noncentral chi-square random variables (which we refer to as the noncentral chi-square difference distribution). As a consequence, we obtain, amongst other results, an exact formula for the probability density function of the noncentral chi-square difference distribution, a Stein characterisation of the noncentral chi-square difference distribution, a simple formula for the moments of the sum of independent copies of the product of correlated normal random variables and an exact formula for the probability that such a random variable is negative.

Probability
$\Chi^2$ Random Fields in Space and Time

Chunsheng Ma

DOI: https://doi.org/10.1109/tsp.2009.2029722

IF: 4.875

2010-01-01

IEEE Transactions on Signal Processing

Abstract:This paper introduces some χ2 random functions,which are not homogeneous (stationary) in general, but contain the stationary case as a special case, and whose correlation structures are nonparametric and flexible so that many parametric forms can be specified. The mean square differentiability of such χ2 random function is discussed.We also make the comparison of two χ2 random functions through their finite-dimensional Laplace transforms.
On the degrees of freedom of a black hole

Diego Pavon

DOI: https://doi.org/10.48550/arXiv.2001.05716

2020-01-16

Abstract:By examining whether black holes fulfill the theorem of equipartition of energy we find that the notion of degrees of freedom, previously introduced for cosmic horizons, is meaningful in the case of Schwarzschild and Kerr black holes. However, for Reissner-Nördstrom and Kerr-Newman black holes this notion fails.

General Relativity and Quantum Cosmology,High Energy Astrophysical Phenomena,High Energy Physics - Theory
New methods to compute the generalized chi-square distribution

Abhranil Das

2024-07-30

Abstract:We present several new mathematical methods (ray-trace, inverse Fourier transform and ellipse) and open-source software to compute the cdf, pdf and inverse cdf of the generalized chi-square distribution. Some methods are geared for speed, while others are designed to be accurate far into the tails, using which we can also measure large values of the discriminability index d' between multinormals. We characterize the performance and limitations of these and previous methods, and recommend the best methods to use for each part of each type of distribution. We also demonstrate the speed and accuracy of our new methods against previous methods across a wide sample of distributions.

Computation,Machine Learning,Methodology
A branch cut approach to the probability density and distribution functions of a linear combination of central and non-central Chi-square random variables

Alfred Kume,Tomonari Sei,Andrew T. A. Wood

DOI: https://doi.org/10.48550/arXiv.2305.07434

2023-05-12

Abstract:The paper considers the distribution of a general linear combination of central and non-central chi-square random variables by exploring the branch cut regions that appear in the standard Laplace inversion process. Due to the original interest from the directional statistics, the focus of this paper is on the density function of such distributions and not on their cumulative distribution function. In fact, our results confirm that the latter is a special case of the former. Our approach provides new insight by generating alternative characterizations of the probability density function in terms of a finite number of feasible univariate integrals. In particular, the central cases seem to allow an interesting representation in terms of the branch cuts, while general degrees of freedom and non-centrality can be easily adopted using recursive differentiation. Numerical results confirm that the proposed approach works well while more transparency and therefore easier control in the accuracy is ensured.

Computation,Probability
Convexity of quantum $χ^2$-divergence

Frank Hansen

DOI: https://doi.org/10.1073/pnas.1106423108

2011-02-20

Abstract:The quantum \chi^2-divergence has recently been introduced and applied to quantum channels (quantum Markov processes). In contrast to the classical setting the quantum \chi^2-divergence is not unique but depends on the choice of quantum statistics. In the reference [11] a special one-parameter family of quantum \chi^2_\alpha(\rho,\sigma)-divergences for density matrices were studied, and it was established that they are convex functions in (\rho,\sigma) for parameter values \alpha\in [0,1], thus mirroring the classical theorem for the \chi^2(p,q)-divergence for probability distributions (p,q). We prove that any quantum \chi^2-divergence is a convex function in its two arguments.

Mathematical Physics
Entropy-variance inequalities for discrete log-concave random variables via degree of freedom

Heshan Aravinda

DOI: https://doi.org/10.1016/j.disc.2023.113683

2023-09-07

Abstract:We utilize a discrete version of the notion of degree of freedom to prove a sharp min-entropy-variance inequality for integer valued log-concave random variables. More specifically, we show that the geometric distribution minimizes the min-entropy within the class of log-concave probability sequences with fixed variance. As an application, we obtain a discrete Rényi entropy power inequality in the log-concave case, which improves a result of Bobkov, Marsiglietti and Melbourne (2022).

Probability,Information Theory
Geometric Interpretation of the Geometric Discord

Yao,Hong-Wei Li,Zhen-Qiang Yin,Zheng-Fu Han

DOI: https://doi.org/10.1016/j.physleta.2011.11.047

IF: 2.707

2012-01-01

Physics Letters A

Abstract:We investigate the level surfaces of geometric measure of quantum discord, and provide a pictorial interpretation of geometric discord for Bell-diagonal states. We have observed its nonanalytic behavior under decoherence employing this approach and interestingly found if we expect geometric discord to remain constant under phase-flip channel for a finite period, the initial state must be separable. Besides, this geometric understanding can be applied to verify the hierarchical relationships between geometric discord and the original one. The present work makes us conjecture that the incompatibility of these two definitions may originate from the discrepancy of the geometric structures of them.
Short proof of the Kneser-Edmonds theorem on the degree of a map between closed surfaces

Andrey Ryabichev

2023-10-10

Abstract:Suppose for closed surfaces $M,N$ there exists a continuous map $f:M\to N$ of geometric degree $d>0$. Then $\chi(M)\le d\cdot\chi(N)$. This inequality was first proved by Kneser in case of orientable surfaces and by Edmonds for arbitrary $M,N$. We give a new simple proof of this result. Our proof is completely elementary and does not use additional techniques (such as the factorisation theorem of Edmonds and the absolute degree theory of Hopf).

Geometric Topology
Generalization of the Alpha-Stable Distribution with the Degree of Freedom

Stephen H. Lihn

2024-05-08

Abstract:A Wright function based framework is proposed to combine and extend several distribution families. The $\alpha$-stable distribution is generalized by adding the degree of freedom parameter. The PDF of this two-sided super distribution family subsumes those of the original $\alpha$-stable, Student's t distributions, as well as the exponential power distribution and the modified Bessel function of the second kind. Its CDF leads to a fractional extension of the Gauss hypergeometric function. The degree of freedom makes possible for valid variance, skewness, and kurtosis, just like Student's t. The original $\alpha$-stable distribution is viewed as having one degree of freedom, that explains why it lacks most of the moments. A skew-Gaussian kernel is derived from the characteristic function of the $\alpha$-stable law, which maximally preserves the law in the new framework. To facilitate such framework, the stable count distribution is generalized as the fractional extension of the generalized gamma distribution. It provides rich subordination capabilities, one of which is the fractional $\chi$ distribution that supplies the needed 'degree of freedom' parameter. Hence, the "new" $\alpha$-stable distribution is a "ratio distribution" of the skew-Gaussian kernel and the fractional $\chi$ distribution. Mathematically, it is a new form of higher transcendental function under the Wright function family. Last, the new univariate symmetric distribution is extended to the multivariate elliptical distribution successfully.

Statistical Finance
Refined normal approximations for the central and noncentral chi-square distributions and some applications

Frédéric Ouimet

DOI: https://doi.org/10.1080/02331888.2022.2084544

IF: 2.346

2022-06-15

Statistics

Abstract:In this paper, we prove a local limit theorem for the chi-square distribution with r >0 degrees of freedom and noncentrality parameter λ≥0 . We use it to develop refined normal approximations for the survival function. Our maximal errors go down to an order of r−2 , which is significantly smaller than the maximal error bounds of order r−1/2 recently found by Horgan and Murphy [On the convergence of the chi square and noncentral chi square distributions to the normal distribution. IEEE Commun Lett. 2013;17(12):2233–2236. DOI:10.1109/LCOMM.2013.111113.131879] and Seri [A tight bound on the distance between a noncentral chi square and a normal distribution. IEEE Commun Lett. 2015;19(11):1877–1880. DOI:10.1109/LCOMM.2015.2461681]. Our results allow us to drastically reduce the number of observations required to obtain negligible errors in the energy detection problem, from 250, as recommended in the seminal work of Urkowitz [Energy detection of unknown deterministic signals. Proc IEEE. 1967;55(4):523–531. DOI:10.1109/PROC.1967.5573], to only 8 here with our new approximations. We also obtain an upper bound on several probability metrics between the central and noncentral chi-square distributions and the standard normal distribution, and we obtain an approximation for the median that improves the lower bound previously obtained by Robert [On some accurate bounds for the quantiles of a noncentral chi squared distribution. Stat Probab Lett. 1990;10(2):101–106. Available from: https://www.ams.org/mathscinet-getitem?mr=MR1072495].

statistics & probability
On the Degrees of Freedom of $R^2$ Gravity in Flat Spacetime

Anamaria Hell,Dieter Lust,George Zoupanos

2023-11-24

Abstract:We study the degrees of freedom of $R^2$ gravity in flat spacetime with two approaches. By rewriting the theory a la Stueckelberg, and implementing Lorentz-like gauges to the metric perturbations, we confirm that the pure theory propagates one scalar degree of freedom, while the full theory contains two tensor modes in addition. We then consider the degrees of freedom by directly examining the metric perturbations. We show that the degrees of freedom of the full theory match with those obtained with the manifestly covariant approach. In contrast, we find that the pure $R^2$ gravity has no degrees of freedom. We show that a similar discrepancy between the two approaches appears also in a theory dual to the three-form, and appears due to the Lorentz-like gauges, which lead to the fictitious modes even after the residual gauge redundancy has been taken into account. At first sight, this implies a discontinuity between the full theory and the pure case. By studying the first-order corrections of the full $R^2$ gravity beyond the linear regime, we show that at high-energies, both scalar and tensor degrees of freedom become strongly coupled. This implies that the apparent discontinuity of pure and full $R^2$ gravity is just an artefact of the perturbation theory, and further supports the absence of degrees of freedom in the pure $R^2$ gravity.

High Energy Physics - Theory,General Relativity and Quantum Cosmology
Cross-ratio degrees and triangulations

Rob Silversmith

2024-08-05

Abstract:The cross-ratio degree problem counts configurations of n points on P^1 with n-3 prescribed cross-ratios. Cross-ratio degrees arise in many corners of combinatorics and geometry, but their structure is not well-understood in general. Interestingly, examining various special cases of the problem can yield combinatorial structures that are both diverse and rich. In this paper we prove a simple closed formula for a class of cross-ratio degrees indexed by triangulations of an n-gon; these degrees are connected to the geometry of the real locus of M_{0,n}, and to positive geometry.

Algebraic Geometry,Combinatorics
A Bernstein-von Mises Theorem for Generalized Fiducial Distributions

J.E. Borgert,Jan Hannig

2024-04-25

Abstract:We prove a Bernstein-von Mises result for generalized fiducial distributions following the approach based on quadratic mean differentiability in Le Cam (1986); van der Vaart (1998). Building on their approach, we introduce only two additional conditions for the generalized fiducial setting. While asymptotic normality of generalized fiducial distributions has been studied before, particularly in Hannig (2009) and Sonderegger and Hannig (2014), this work significantly extends the usefulness of such a result by the much more general condition of quadratic mean differentiability. We demonstrate the applicability of our result with two examples that necessitate these more general assumptions: the triangular distributions and free-knot spline models.

Statistics Theory
What is a degree of freedom? Configuration spaces and their topology

Juan Margalef-Bentabol,Leigh Herman,Ivan Booth

2024-07-31

Abstract:Understanding degrees of freedom in classical mechanics is fundamental to characterizing physical systems. Counting them is usually easy, especially if we can assign them a clear meaning. However, the precise definition of a degree of freedom is not usually presented in first-year physics courses since it requires mathematical knowledge only learned in more advanced courses. In this paper, we use a pedagogical approach motivated by simple but non-trivial mechanical examples to define degrees of freedom and configuration spaces. We highlight the role that topology plays in understanding these ideas.

Classical Physics,Mathematical Physics
On the Geometry of Bayesian Inference

Miguel de Carvalho,Garritt L. Page,Bradley J. Barney

DOI: https://doi.org/10.1214/18-ba1112

2019-12-01

Bayesian Analysis

Abstract:We provide a geometric interpretation to Bayesian inference that allows us to introduce a natural measure of the level of agreement between priors, likelihoods, and posteriors. The starting point for the construction of our geometry is the observation that the marginal likelihood can be regarded as an inner product between the prior and the likelihood. A key concept in our geometry is that of compatibility, a measure which is based on the same construction principles as Pearson correlation, but which can be used to assess how much the prior agrees with the likelihood, to gauge the sensitivity of the posterior to the prior, and to quantify the coherency of the opinions of two experts. Estimators for all the quantities involved in our geometric setup are discussed, which can be directly computed from the posterior simulation output. Some examples are used to illustrate our methods, including data related to on-the-job drug usage, midge wing length, and prostate cancer.

statistics & probability,mathematics, interdisciplinary applications

The Geometry of Chi-Square Degrees of Freedom

The nonparametric Fisher geometry and the chi-square process density prior

Degrees of freedom in discrete geometry

Random Triangle Theory with Geometry and Applications

Log-concavity and discrete degrees of freedom

On the product of correlated normal random variables and the noncentral chi-square difference distribution

$\Chi^2$ Random Fields in Space and Time

On the degrees of freedom of a black hole

New methods to compute the generalized chi-square distribution

A branch cut approach to the probability density and distribution functions of a linear combination of central and non-central Chi-square random variables

Convexity of quantum $χ^2$-divergence

Entropy-variance inequalities for discrete log-concave random variables via degree of freedom

Geometric Interpretation of the Geometric Discord

Short proof of the Kneser-Edmonds theorem on the degree of a map between closed surfaces

Generalization of the Alpha-Stable Distribution with the Degree of Freedom

Refined normal approximations for the central and noncentral chi-square distributions and some applications

On the Degrees of Freedom of $R^2$ Gravity in Flat Spacetime

Cross-ratio degrees and triangulations

A Bernstein-von Mises Theorem for Generalized Fiducial Distributions

What is a degree of freedom? Configuration spaces and their topology

On the Geometry of Bayesian Inference