Correction on Moments of minors of Wishart matrices

Mathias Drton,Aldo Goia

DOI: https://doi.org/10.1214/12-AOS988

2012-08-16

Abstract:Correction on Moments of minors of Wishart matrices by M. Drton and A. Goia (Ann. Statist. 36 (2008) 2261-2283), <a class="link-https" data-arxiv-id="math/0604488" href="https://arxiv.org/abs/math/0604488">arXiv:math/0604488</a>

Statistics Theory

What problem does this paper attempt to address?

An Introduction to Wishart Matrix Moments

Adrian N. Bishop,Pierre Del Moral,Angele Niclas

DOI: https://doi.org/10.1561/2200000072

2019-02-10

Abstract:These lecture notes provide a comprehensive, self-contained introduction to the analysis of Wishart matrix moments. This study may act as an introduction to some particular aspects of random matrix theory, or as a self-contained exposition of Wishart matrix moments. Random matrix theory plays a central role in statistical physics, computational mathematics and engineering sciences, including data assimilation, signal processing, combinatorial optimization, compressed sensing, econometrics and mathematical finance, among numerous others. The mathematical foundations of the theory of random matrices lies at the intersection of combinatorics, non-commutative algebra, geometry, multivariate functional and spectral analysis, and of course statistics and probability theory. As a result, most of the classical topics in random matrix theory are technical, and mathematically difficult to penetrate for non-experts and regular users and practitioners. The technical aim of these notes is to review and extend some important results in random matrix theory in the specific context of real random Wishart matrices. This special class of Gaussian-type sample covariance matrix plays an important role in multivariate analysis and in statistical theory. We derive non-asymptotic formulae for the full matrix moments of real valued Wishart random matrices. As a corollary, we derive and extend a number of spectral and trace-type results for the case of non-isotropic Wishart random matrices. We also derive the full matrix moment analogues of some classic spectral and trace-type moment results. For example, we derive semi-circle and Marchencko-Pastur-type laws in the non-isotropic and full matrix cases. Laplace matrix transforms and matrix moment estimates are also studied, along with new spectral and trace concentration-type inequalities.

Probability,Combinatorics
On Wilks' joint moment formulas for embedded principal minors of Wishart random matrices

C. Genest,F. Ouimet,D. Richards

DOI: https://doi.org/10.1002/sta4.706

2024-06-14

Stat

Abstract:In 1934, the American statistician Samuel S. Wilks derived remarkable formulas for the joint moments of embedded principal minors of sample covariance matrices in multivariate Gaussian populations, and he used them to compute the moments of sample statistics in various applications related to multivariate linear regression. These important but little‐known moment results were extended in 1963 by the Australian statistician A. Graham Constantine using Bartlett's decomposition. In this note, a new proof of Wilks' results is derived using the concept of iterated Schur complements, thereby bypassing Bartlett's decomposition. Furthermore, Wilks' open problem of evaluating joint moments of disjoint principal minors of Wishart random matrices is related to the Gaussian product inequality conjecture.

statistics & probability
An explicit Wishart moment formula for the product of two disjoint principal minors

Christian Genest,Frédéric Ouimet,Donald Richards

2024-09-23

Abstract:This paper provides the first explicit formula for the expectation of the product of two disjoint principal minors of a Wishart random matrix, solving a part of a broader problem put forth by Samuel S. Wilks in 1934 in the Annals of Mathematics. The proof makes crucial use of hypergeometric functions of matrix argument and their Laplace transforms. Additionally, a Wishart generalization of the Gaussian product inequality conjecture is formulated and a stronger quantitative version is proved to hold in the case of two minors.

Probability,Statistics Theory
On the Gaussian product inequality conjecture for disjoint principal minors of Wishart random matrices

Christian Genest,Frédéric Ouimet,Donald Richards

2024-10-01

Abstract:This paper extends various results related to the Gaussian product inequality (GPI) conjecture to the setting of disjoint principal minors of Wishart random matrices. This includes product-type inequalities for matrix-variate analogs of completely monotone functions and Bernstein functions of Wishart disjoint principal minors, respectively. In particular, the product-type inequalities apply to inverse determinant powers. Quantitative versions of the inequalities are also obtained when there is a mix of positive and negative exponents. Furthermore, an extended form of the GPI is shown to hold for the eigenvalues of Wishart random matrices by virtue of their law being multivariate totally positive of order 2 (MTP${}_2$). A new, unexplored avenue of research is presented to study the GPI from the point of view of elliptical distributions.

Statistics Theory,Functional Analysis,Probability
Error Bound for Compound Wishart Matrices

Ilya Soloveychik

DOI: https://doi.org/10.48550/arXiv.1402.5581

2014-03-13

Abstract:In this paper we consider non-asymptotic behavior of the real compound Wishart matrices that generalize the classical real Wishart distribution. In particular, we consider matrices of the form 1/nXBX', where X consists of real centered Gaussian elements and B is an arbitrary real matrix and sequences of such matrices for varying n. We show how the expectation of deviations from the mean can be bounded for compound Wishart matrices.

Applications
Moderate deviations for the eigenvalue counting function of Wigner matrices

Hanna Doering,Peter Eichelsbacher

DOI: https://doi.org/10.48550/arXiv.1104.0221

2011-04-01

Probability

Abstract:We establish a moderate deviation principle (MDP) for the number of eigenvalues of a Wigner matrix in an interval. The proof relies on fine asymptotics of the variance of the eigenvalue counting function of GUE matrices due to Gustavsson. The extension to large families of Wigner matrices is based on the Tao and Vu Four Moment Theorem and applies localization results by Erd\"os, Yau and Yin. Moreover we investigate families of covariance matrices as well.
A Note on the Limiting Mean Distribution of Singular Values for Products of Two Wishart Random Matrices

Lun Zhang

DOI: https://doi.org/10.1063/1.4818978

IF: 1.469

2013-01-01

Journal of Mathematical Physics

Abstract:The product of M complex random Gaussian matrices of size N has recently been studied by Akemann, Kieburg, and Wei. They showed that, for fixed M and N, the joint probability distribution for the squared singular values of the product matrix forms a determinantal point process with a correlation kernel determined by certain biorthogonal polynomials that can be explicitly constructed. We find that, in the case M = 2, the relevant biorthogonal polynomials are actually special cases of multiple orthogonal polynomials associated with Macdonald functions (modified Bessel functions of the second kind) which was first introduced by Van Assche and Yakubovich. With known results on asymptotic zero distribution of these polynomials and general theory on multiple orthogonal polynomial ensembles, it is then easy to obtain an explicit expression for the distribution of squared singular values for the product of two complex random Gaussian matrices in the limit of large matrix dimensions.
On the expectations of equivariant matrix‐valued functions of Wishart and inverse Wishart matrices

Grant Hillier,Raymond M. Kan

DOI: https://doi.org/10.1111/sjos.12707

2024-01-31

Scandinavian Journal of Statistics

Abstract:Many matrix‐valued functions of an m×m Wishart matrix W , Fk(W) , say, are homogeneous of degree k in W , and are equivariant under the conjugate action of the orthogonal group O(m), that is, Fk(HWHT)=HFk(W)HT , H∈O(m). It is easy to see that the expectation of such a function is itself homogeneous of degree k in Σ , the covariance matrix, and are also equivariant under the action of O(m) on Σ . The space of such homogeneous, equivariant, matrix‐valued functions is spanned by elements of the type Wrpλ(W) , where r∈{0,...,k} and, for each r , λ varies over the partitions of k−r , and pλ(W) denotes the power‐sum symmetric function indexed by λ . In the analogous case where W is replaced by W−1 , these elements are replaced by W−rpλ(W−1) . In this paper, we derive recurrence relations and analytical expressions for the expectations of such functions. Our results provide highly efficient methods for the computation of all such moments.

statistics & probability
Largest Eigenvalues of Principal Minors of Deformed Gaussian Orthogonal Ensembles and Wishart Matrices

Tiefeng Jiang,Yongcheng Qi

2024-10-20

Abstract:Consider a high-dimensional Wishart matrix $\bd{W}=\bd{X}^T\bd{X}$ where the entries of $\bd{X}$ are i.i.d. random variables with mean zero, variance one, and a finite fourth moment $\eta$. Motivated by problems in signal processing and high-dimensional statistics, we study the maximum of the largest eigenvalues of any two-by-two principal minors of $\bd{W}$. Under certain restrictions on the sample size and the population dimension of $\bd{W}$, we obtain the limiting distribution of the maximum, which follows the Gumbel distribution when $\eta$ is between 0 and 3, and a new distribution when $\eta$ exceeds 3. To derive this result, we first address a simpler problem on a new object named a deformed Gaussian orthogonal ensemble (GOE). The Wishart case is then resolved using results from the deformed GOE and a high-dimensional central limit theorem. Our proof strategy combines the Stein-Poisson approximation method, conditioning, U-statistics, and the Hájek projection. This method may also be applicable to other extreme-value problems. Some open questions are posed.

Probability
A recursion formula for mixed trace moments of isotropic Wishart matrices and the Gaussian unitary/orthogonal ensembles

Ben Deitmar

2024-04-10

Abstract:Exact recursion formulas for mixed moments of four fundamental random matrix ensembles are derived. The reason such recursive formulas are possible is closely related to properties of polygon gluings studied by Harer and Zagier as well as Akhmedov and Shakirov. The proofs of the formulas are direct and written in such a way that they do not rely on understanding of polygon gluings.

Probability,Statistics Theory
Extreme eigenvalues of principal minors of random matrix with moment conditions

Jianwei Hu,Seydou Keita,Kang Fu

2023-06-14

Abstract:Let $\bm{x}_1,\cdots,\bm{x}_n$ be a random sample of size $n$ from a $p$-dimensional population distribution, where $p=p(n)\rightarrow\infty$. Consider a symmetric matrix $W=X^\top X$ with parameters $n$ and $p$, where $X=(\bm{x}_1,\cdots,\bm{x}_n)^\top$. In this paper, motivated by model selection theory in high-dimensional statistics, we mainly investigate the asymptotic behavior of the eigenvalues of the principal minors of the random matrix $W$. For the Gaussian case, under a simple condition that $m=o(n/\log p)$, we obtain the asymptotic results on maxima and minima of the eigenvalues of all $m\times m$ principal minors of $W$. We also extend our results to general distributions with some moment conditions. Moreover, we gain the asymptotic results of the extreme eigenvalues of the principal minors in the case of the real Wigner matrix. Finally, similar results for the maxima and minima of the eigenvalues of all the principal minors with a size smaller than or equal to $m$ are also given.

Probability
Hasse-Witt and Cartier-Manin matrices: A warning and a request

Jeffrey D. Achter,Everett W. Howe

DOI: https://doi.org/10.1090/conm/722/14534

2020-02-08

Abstract:Let X be a curve in positive characteristic. A Hasse--Witt matrix for X is a matrix that represents the action of the Frobenius operator on the cohomology group H^1(X,O_X) with respect to some basis. A Cartier--Manin matrix for X is a matrix that represents the action of the Cartier operator on the space of holomorphic differentials of X with respect to some basis. The operators that these matrices represent are adjoint to one another, so Hasse--Witt matrices and the Cartier--Manin matrices are related to one another, but there seems to be a fair amount of confusion in the literature about the exact nature of this relationship. This confusion arises from differences in terminology, from differing conventions about whether matrices act on the left or on the right, and from misunderstandings about the proper formulae for iterating semilinear operators. Unfortunately, this confusion has led to the publication of incorrect results. In this paper we present the issues involved as clearly as we can, and we look through the literature to see where there may be problems. We encourage future authors to clearly distinguish between Hasse--Witt and Cartier--Manin matrices, in the hope that further errors can be avoided.

Number Theory,Algebraic Geometry
A Note on Improved Multivariate Normal Mean Estimation With Unknown Covariance When p Is Greater Than n

Arash A. Foroushani,Severien Nkurunziza

2024-06-24

Abstract:In this paper, we highlight a major error in the proofs of the important results of [D.Chételat and M. T. Wells(2012). Improved Multivariate Normal Mean Estimation with Unknown Covariance when p is Greater than n. The Annals of Statistics, Vol. 40, No.6, 3137--3160]. In particular, the proofs of some of their main results are based on Theorem 2 whose proof needs to be revisited. More precisely, there are some major mistakes in the derivation of this important result. Further, under a very realistic assumption about the rank of the estimator of the variance-covariance matrix, we correct the proof of the quoted result.

Statistics Theory
Completing the picture for the smallest eigenvalue of real Wishart matrices

G. Akemann,T. Guhr,M. Kieburg,R. Wegner,T. Wirtz

DOI: https://doi.org/10.1103/PhysRevLett.113.250201

2015-03-09

Abstract:Rectangular real $N \times (N + \nu)$ matrices $W$ with a Gaussian distribution appear very frequently in data analysis, condensed matter physics and quantum field theory. A central question concerns the correlations encoded in the spectral statistics of $WW^T$. The extreme eigenvalues of $W W^T$ are of particular interest. We explicitly compute the distribution and the gap probability of the smallest non-zero eigenvalue in this ensemble, both for arbitrary fixed $N$ and $\nu$, and in the universal large $N$ limit with $\nu$ fixed. We uncover an integrable Pfaffian structure valid for all even values of $\nu\geq 0$. This extends previous results for odd $\nu$ at infinite $N$ and recursive results for finite $N$ and for all $\nu$. Our mathematical results include the computation of expectation values of half integer powers of characteristic polynomials.

Mathematical Physics,Statistical Mechanics,High Energy Physics - Lattice
The Smallest Eigenvalue Distribution in the Real Wishart-Laguerre Ensemble with Even Topology

Tim Wirtz,Gernot Akemann,Thomas Guhr,Mario Kieburg,René Wegner

DOI: https://doi.org/10.48550/arXiv.1502.03685

2015-05-20

Abstract:We consider rectangular random matrices of size $p\times n$ belonging to the real Wishart-Laguerre ensemble also known as the chiral Gaussian orthogonal ensemble. This ensemble appears in many applications like QCD, mesoscopic physics, and time series analysis. We are particularly interested in the distribution of the smallest non-zero eigenvalue and the gap probability to find no eigenvalue in an interval $[0,t]$. While for odd topology $\nu=n-p$ explicit closed results are known for finite and infinite matrix size, for even $\nu>2$ only recursive expressions in $p$ are <a class="link-external link-http" href="http://available.The" rel="external noopener nofollow">this http URL</a> smallest eigenvalue distribution as well as the gap probability for general even $\nu$ is equivalent to expectation values of characteristic polynomials raised to a half-integer. The computation of such averages is done via a combination of skew-orthogonal polynomials and bosonisation methods. The results are given in terms of Pfaffian determinants both at finite $p$ and in the hard edge scaling limit ($p\to\infty$ and $\nu$ fixed) for an arbitrary even topology $\nu$. Numerical simulations for the correlated Wishart ensemble illustrate the universality of our results in this particular limit. These simulations point to a validity of the hard edge scaling limit beyond the invariant case.

Mathematical Physics,Statistical Mechanics,High Energy Physics - Lattice
On the Matricial Truncated Moment Problem. II

Conrad Mädler,Konrad Schmüdgen

2023-11-17

Abstract:We continue the study of truncated matrix-valued moment problems begun in <a class="link-https" data-arxiv-id="2310.00957" href="https://arxiv.org/abs/2310.00957">arXiv:2310.00957</a>. Let $q\in\mathbb{N}$. Suppose that $(\mathcal{X},\mathfrak{X})$ is a measurable space and $\mathcal{E}$ is a finite-dimensional vector space of measurable mappings of $\mathscr{X}$ into $\mathcal{H}_q$, the Hermitian $q\times q$ matrices. A linear functional $\Lambda$ on $\mathcal{E}$ is called a moment functional if there exists a positive $\mathcal{H}_q$-valued measure $\mu$ on $(\mathcal{X},\mathfrak{X})$ such that $\Lambda(F)=\int_\mathcal{X} \langle F, \mathrm{d}\mu\rangle$ for $F\in \mathcal{E}$. In this paper a number of special topics on the truncated matricial moment problem are treated. We restate a result from (Mourrain and Schmüdgen, 2016) to obtain a matricial version of the flat extension theorem. Assuming that $\mathcal{X}$ is a compact space and all elements of $ \mathcal{E}$ are continuous on $\mathcal{X}$ we characterize moment functionals in terms of positivity and obtain an ordered maximal mass representing measure for each moment functional. The set of masses of representing measures at a fixed point and some related sets are studied. The class of commutative matrix moment functionals is investigated. We generalize the apolar scalar product for homogeneous polynomials to the matrix case and apply this to the matricial truncated moment problem.

Functional Analysis
On Wishart distribution

Jose A. Diaz-Garcia,Ramon Gutierrez-Jaimez

DOI: https://doi.org/10.48550/arXiv.1010.1799

2010-10-09

Abstract:This paper proposes a unified approach that enables the Wishart distribution to be studied simultaneously in the real, complex, quaternion and octonion cases. In particular, the noncentral generalised Wishart distribution, the joint density of the eigenvalues and the distribution of the maximum eigenvalue are obtained for real normed division algebras.

Statistics Theory
Perturbation of Partitioned Hermitian Definite Generalized Eigenvalue Problems.

Ren-Cang Li,Yuji Nakatsukasa,Ninoslav Truhar,Shufang Xu

DOI: https://doi.org/10.1137/100808356

IF: 1.908

2011-01-01

SIAM Journal on Matrix Analysis and Applications

Abstract:The main purpose of this erratum is to correct mistakes in the proof of Theorem 2.4of [R.-C. Li et al., SIAM J. Matrix Anal. Appl. , 32 (2011), pp. 642--663]and in the inequalities (2.23), (2.24), and (2.25) on p. 653 of the same paper.
A Note on the Matrix Moment Problem and its Relation with Matrix Biorthogonal Polynomials

García-Ardila, Juan Carlos

DOI: https://doi.org/10.1007/s00025-024-02161-z

2024-04-20

Results in Mathematics

Abstract:In this manuscript, we study the operator moment problem for a block tridiagonal non-symmetric matrix. To study this problem, we used the relation between the resolvent function and a sequence of left-matrix orthogonal polynomials with respect to the sesquilinear form defined from the operator.

mathematics, applied

Correction on Moments of minors of Wishart matrices

An Introduction to Wishart Matrix Moments

On Wilks' joint moment formulas for embedded principal minors of Wishart random matrices

An explicit Wishart moment formula for the product of two disjoint principal minors

On the Gaussian product inequality conjecture for disjoint principal minors of Wishart random matrices

Error Bound for Compound Wishart Matrices

Moderate deviations for the eigenvalue counting function of Wigner matrices

A Note on the Limiting Mean Distribution of Singular Values for Products of Two Wishart Random Matrices

On the expectations of equivariant matrix‐valued functions of Wishart and inverse Wishart matrices

Largest Eigenvalues of Principal Minors of Deformed Gaussian Orthogonal Ensembles and Wishart Matrices

A recursion formula for mixed trace moments of isotropic Wishart matrices and the Gaussian unitary/orthogonal ensembles

Extreme eigenvalues of principal minors of random matrix with moment conditions

Hasse-Witt and Cartier-Manin matrices: A warning and a request

A Note on Improved Multivariate Normal Mean Estimation With Unknown Covariance When p Is Greater Than n

Completing the picture for the smallest eigenvalue of real Wishart matrices

The Smallest Eigenvalue Distribution in the Real Wishart-Laguerre Ensemble with Even Topology

On the Matricial Truncated Moment Problem. II

On Wishart distribution

Perturbation of Partitioned Hermitian Definite Generalized Eigenvalue Problems.

A Note on the Matrix Moment Problem and its Relation with Matrix Biorthogonal Polynomials