Several applications of the moment method in random matrix theory

Sasha Sodin

DOI: https://doi.org/10.48550/arXiv.1406.3410

2014-06-13

Abstract:Several applications of the moment method in random matrix theory, especially, to local eigenvalue statistics at the spectral edges, are surveyed, with emphasis on a modification of the method involving orthogonal polynomials.

Classical Analysis and ODEs,Mathematical Physics,Probability

What problem does this paper attempt to address?

Randomized methods for computing joint eigenvalues, with applications to multiparameter eigenvalue problems and root finding

Haoze He,Daniel Kressner,Bor Plestenjak

2024-09-01

Abstract:It is well known that a family of $n\times n$ commuting matrices can be simultaneously triangularized by a unitary similarity transformation. The diagonal entries of the triangular matrices define the $n$ joint eigenvalues of the family. In this work, we consider the task of numerically computing approximations to such joint eigenvalues for a family of (nearly) commuting matrices. This task arises, for example, in solvers for multiparameter eigenvalue problems and systems of multivariate polynomials, which are our main motivations. We propose and analyze a simple approach that computes eigenvalues as one-sided or two-sided Rayleigh quotients from eigenvectors of a random linear combination of the matrices in the family. We provide some analysis and numerous numerical examples, showing that such randomized approaches can compute semisimple joint eigenvalues accurately and lead to improved performance of existing solvers.

Numerical Analysis
A Riemann--Hilbert approach to the perturbation theory for orthogonal polynomials: Applications to numerical linear algebra and random matrix theory

Xiucai Ding,Thomas Trogdon

DOI: https://doi.org/10.48550/arXiv.2112.12354

2022-09-22

Abstract:We establish a new perturbation theory for orthogonal polynomials using a Riemann--Hilbert approach and consider applications in numerical linear algebra and random matrix theory. This new approach shows that the orthogonal polynomials with respect to two measures can be effectively compared using the difference of their Stieltjes transforms on a suitably chosen contour. Moreover, when two measures are close and satisfy some regularity conditions, we use the theta functions of a hyperelliptic Riemann surface to derive explicit and accurate expansion formulae for the perturbed orthogonal polynomials. In contrast to other approaches, a key strength of the methodology is that estimates can remain valid as the degree of the polynomial grows. The results are applied to analyze several numerical algorithms from linear algebra, including the Lanczos tridiagonalization procedure, the Cholesky factorization and the conjugate gradient algorithm. As a case study, we investigate these algorithms applied to a general spiked sample covariance matrix model by considering the eigenvector empirical spectral distribution and its limits. For the first time, we give precise estimates on the output of the algorithms, applied to this wide class of random matrices, as the number of iterations diverges. In this setting, beyond the first order expansion, we also derive a new mesoscopic central limit theorem for the associated orthogonal polynomials and other quantities relevant to numerical algorithms.

Probability,Mathematical Physics,Numerical Analysis
Infinite Random Matrix Theory, Tridiagonal Bordered Toeplitz Matrices, and the Moment Problem

Alexander Dubbs,Alan Edelman

DOI: https://doi.org/10.48550/arXiv.1502.04931

2015-02-17

Abstract:The four major asymptotic level density laws of random matrix theory may all be showcased though their Jacobi parameter representation as having a bordered Toeplitz form. We compare and contrast these laws, completing and exploring their representations in one place. Inspired by the bordered Toeplitz form, we propose an algorithm for the finite moment problem by proposing a solution whose density has a bordered Toeplitz form.

Probability
Applications of multiple orthogonal polynomials with hypergeometric moment generating functions

Thomas Wolfs

2024-04-16

Abstract:We investigate several families of multiple orthogonal polynomials associated with weights for which the moment generating functions are hypergeometric series with slightly varying parameters. The weights are supported on the unit interval, the positive real line, or the unit circle and the multiple orthogonal polynomials are generalizations of the Jacobi, Laguerre or Bessel orthogonal polynomials. We give explicit formulas for the type I and type II multiple orthogonal polynomials and study some of their properties. In particular, we describe the asymptotic distribution of the (scaled) zeros of the type II multiple orthogonal polynomials via the free convolution. Essential to our overall approach is the use of the Mellin transform. Finally, we discuss two applications. First, we show that the multiple orthogonal polynomials appear naturally in the study of the squared singular values of (mixed) products of truncated unitary random matrices and Ginibre matrices. Secondly, we use the multiple orthogonal polynomials to simultaneously approximate certain hypergeometric series and to provide an explicit proof of their $\mathbb{Q}$-linear independence.

Classical Analysis and ODEs,Number Theory
Applications of the Hahn-Banach Theorem, a Solution of the Moment Problem and the Related Approximation

Octav Olteanu

DOI: https://doi.org/10.3390/math12182878

IF: 2.4

2024-09-16

Mathematics

Abstract:We start by an application the of Krein–Milman theorem to the integral representation of completely monotonic functions. Elements of convex optimization are also mentioned. The paper continues with applications of Hahn–Banach-type theorems and polynomial approximation to obtain recent results on the moment problem on the unbounded closed interval . Necessary and sufficient conditions for the existence and uniqueness of the solution are pointed out. Operator-valued moment problems and a scalar-valued moment problem are solved.

mathematics
Real moments of the logarithmic derivative of characteristic polynomials in random matrix ensembles

Fan Ge

2024-04-03

Abstract:We prove asymptotics for real moments of the logarithmic derivative of characteristic polynomials evaluated at $1-\frac{a}{N}$ in unitary, even orthogonal, and symplectic ensembles, where $a>0$ and $a=o(1)$ as the size $N$ of the matrix goes to infinity. Previously, such asymptotics were known only for integer moments (in the unitary ensemble by the work of Bailey, Bettin, Blower, Conrey, Prokhorov, Rubinstein and Snaith, and in orthogonal and symplectic ensembles by the work of Alvarez and Snaith), except that in the odd orthogonal ensemble real moments asymptotics were obtained by Alvarez, Bousseyroux and Snaith. Our proof is new and does not make use of the aforementioned integer moments results, and is different from the method in the work of Alvarez et al for the odd orthogonal ensemble.

Mathematical Physics,Number Theory
Deriving Matrix Concentration Inequalities from Kernel Couplings

Daniel Paulin,Lester Mackey,Joel A. Tropp

DOI: https://doi.org/10.48550/arXiv.1305.0612

2013-05-03

Abstract:This paper derives exponential tail bounds and polynomial moment inequalities for the spectral norm deviation of a random matrix from its mean value. The argument depends on a matrix extension of Stein's method of exchangeable pairs for concentration of measure, as introduced by Chatterjee. Recent work of Mackey et al. uses these techniques to analyze random matrices with additive structure, while the enhancements in this paper cover a wider class of matrix-valued random elements. In particular, these ideas lead to a bounded differences inequality that applies to random matrices constructed from weakly dependent random variables. The proofs require novel trace inequalities that may be of independent interest.

Probability,Functional Analysis
Approximating matrix eigenvalues by subspace iteration with repeated random sparsification

Samuel M. Greene,Robert J. Webber,Timothy C. Berkelbach,Jonathan Weare

DOI: https://doi.org/10.1137/21M1422513

2022-03-03

Abstract:Traditional numerical methods for calculating matrix eigenvalues are prohibitively expensive for high-dimensional problems. Iterative random sparsification methods allow for the estimation of a single dominant eigenvalue at reduced cost by leveraging repeated random sampling and averaging. We present a general approach to extending such methods for the estimation of multiple eigenvalues and demonstrate its performance for several benchmark problems in quantum chemistry.

Numerical Analysis,Strongly Correlated Electrons,Chemical Physics
Concentration Inequalities for Sums of Markov Dependent Random Matrices

Joe Neeman,Bobby Shi,Rachel Ward

2023-10-17

Abstract:We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing previous that had only considered Hoeffding-type inequalities, and only for time-independent functions on a finite state space. In particular, we study a kind of noncommutative moment generating function, give tight bounds on it, and use a method of Garg et al. to turn this into tail bounds. Our proof proceeds spectrally, bounding the norm of a certain perturbed operator. In the process we make an interesting connection to dynamical systems and Banach space theory to prove a crucial result on the limiting behavior of our moment generating function that may be of independent interest.

Probability
Applications of Moments of Dirichlet Coefficients in Elliptic Curve Families

Zoë Batterman,Aditya Jambhale,Steven J. Miller,Akash L. Narayanan,Kishan Sharma,Andrew Yang,Chris Yao

2024-06-18

Abstract:The moments of the coefficients of elliptic curve L-functions are related to numerous arithmetic problems. Rosen and Silverman proved a conjecture of Nagao relating the first moment of one-parameter families satisfying Tate's conjecture to the rank of the corresponding elliptic surface over Q(T); one can also construct families of moderate rank by finding families with large first moments. Michel proved that if j(T) is not constant, then the second moment of the family is of size p^2 + O(p^(3/2)); these two moments show that for suitably small support the behavior of zeros near the central point agree with that of eigenvalues from random matrix ensembles, with the higher moments impacting the rate of convergence. In his thesis, Miller noticed a negative bias in the second moment of every one-parameter family of elliptic curves over the rationals whose second moment had a calculable closed-form expression, specifically the first lower order term which does not average to zero is on average negative. This Bias Conjecture is confirmed for many families; however, these are highly non-generic families whose resulting Legendre sums can be determined. Inspired by the recent successes by Yang-Hui He, Kyu-Hwan Lee, Thomas Oliver, Alexey Pozdnyakov and others in investigations of murmurations of elliptic curve coefficients with machine learning techniques, we pose a similar problem for trying to understand the Bias Conjecture. As a start to this program, we numerically investigate the Bias Conjecture for a family whose bias is positive for half the primes. Since the numerics do not offer conclusive evidence that negative bias for the other half is enough to overwhelm the positive bias, the Bias Conjecture cannot be verified for the family.

Number Theory,Numerical Analysis
Non-asymptotic theory of random matrices: extreme singular values

Mark Rudelson,Roman Vershynin

DOI: https://doi.org/10.48550/arXiv.1003.2990

2010-04-08

Abstract:The classical random matrix theory is mostly focused on asymptotic spectral properties of random matrices as their dimensions grow to infinity. At the same time many recent applications from convex geometry to functional analysis to information theory operate with random matrices in fixed dimensions. This survey addresses the non-asymptotic theory of extreme singular values of random matrices with independent entries. We focus on recently developed geometric methods for estimating the hard edge of random matrices (the smallest singular value).

Functional Analysis,Probability
Important moments in systems, control and optimization

Christopher I. Byrnes,Anders Lindquist

DOI: https://doi.org/10.1109/CDC.2009.5400258

2009-01-01

Abstract:The moment problem matured from its various special forms in the late 19th and early 20th Centuries to a general class of problems that continues to exert profound influence on the development of analysis and its applications to a wide variety of fields. In particular, the theory of systems and control is no exception, where the applications have historically been to circuit theory, optimal control, robust control, signal processing, spectral estimation, stochastic realization theory and the use of the moments of a probability density. Many of these applications are also still works in progress. In this paper, we consider the generalized moment problem, expressed in terms of a basis of a finite-dimensional subspace P of the Banach space C[a, b] and a Â¿positiveÂ¿ sequences c, but with a new wrinkle inspired by the applications to systems and control. We seek to parameterize solutions which are positive Â¿rationalÂ¿ measures, in a suitably generalized sense. Our parameterization is given in terms of smooth objects. In particular, the desired solution space arises naturally as a manifold which can be shown to be diffeomorphic to a Euclidean space and which is the domain of some canonically defined functions. Moreover, on these spaces one can derive natural convex optimization criteria which characterize solutions to this new class of moment problems.
Multiple orthogonal polynomials in random matrix theory

Arno B.J. Kuijlaars

DOI: https://doi.org/10.48550/arXiv.1004.0846

2010-04-06

Abstract:Multiple orthogonal polynomials are a generalization of orthogonal polynomials in which the orthogonality is distributed among a number of orthogonality weights. They appear in random matrix theory in the form of special determinantal point processes that are called multiple orthogonal polynomial (MOP) ensembles. The correlation kernel in such an ensemble is expressed in terms of the solution of a Riemann-Hilbert problem, that is of size (r+1) x (r+1) in the case of r weights. A number of models give rise to a MOP ensemble, and we discuss recent results on models of non-intersecting Brownian motions, Hermitian random matrices with external source, and the two matrix model. A novel feature in the asymptotic analysis of the latter two models is a vector equilibrium problem for two or more measures, that describes the limiting mean eigenvalue density. The vector equilibrium problems involve both an external field and an upper constraint.

Classical Analysis and ODEs,Probability
Important Moments in Systems and Control

Christopher I. Byrnes,Anders Lindquist

DOI: https://doi.org/10.1137/070693941

IF: 2.2

2008-01-01

SIAM Journal on Control and Optimization

Abstract:The moment problem matured from its various special forms in the late 19th and early 20th centuries to a general class of problems that continues to exert profound influence on the development of analysis and its applications to a wide variety of fields. In particular, the theory of systems and control is no exception, where the applications have historically been to circuit theory, optimal control, robust control, signal processing, spectral estimation, stochastic realization theory, and the use of the moments of a probability density. Many of these applications are also still works in progress. In this paper, we consider the generalized moment problem, expressed in terms of a basis of a finite-dimensional subspace P of the Banach space $C[a,b]$ and a “positive” sequence $c$, but with a new wrinkle inspired by the applications to systems and control. We seek to parameterize solutions which are positive “rational” measures in a suitably generalized sense. Our parameterization is given in terms of smooth objects. In particular, the desired solution space arises naturally as a manifold which can be shown to be diffeomorphic to a Euclidean space and which is the domain of some canonically defined functions. The analysis of these functions, and related maps, yields interesting corollaries for the moment problem and its applications, which we compare to those in the recent literature and which play a crucial role in part of our proof.
Numerically Stable Evaluation of Moments of Random Gram Matrices with Applications

Khalil Elkhalil,Abla Kammoun,Tareq Y. Al-Naffouri,Mohamed-Slim Alouini

DOI: https://doi.org/10.1109/LSP.2017.2731373

2017-01-09

Abstract:This paper is focuses on the computation of the positive moments of one-side correlated random Gram matrices. Closed-form expressions for the moments can be obtained easily, but numerical evaluation thereof is prone to numerical stability, especially in high-dimensional settings. This letter provides a numerically stable method that efficiently computes the positive moments in closed-form. The developed expressions are more accurate and can lead to higher accuracy levels when fed to moment based-approaches. As an application, we show how the obtained moments can be used to approximate the marginal distribution of the eigenvalues of random Gram matrices.

Information Theory
Analysis of eigenvalue condition numbers for a class of randomized numerical methods for singular matrix pencils

Daniel Kressner,Bor Plestenjak

DOI: https://doi.org/10.1007/s10543-024-01033-w

2024-01-11

Abstract:The numerical solution of the generalized eigenvalue problem for a singular matrix pencil is challenging due to the discontinuity of its eigenvalues. Classically, such problems are addressed by first extracting the regular part through the staircase form and then applying a standard solver, such as the QZ algorithm, to that regular part. Recently, several novel approaches have been proposed to transform the singular pencil into a regular pencil by relatively simple randomized modifications. In this work, we analyze three such methods by Hochstenbach, Mehl, and Plestenjak that modify, project, or augment the pencil using random matrices. All three methods rely on the normal rank and do not alter the finite eigenvalues of the original pencil. We show that the eigenvalue condition numbers of the transformed pencils are unlikely to be much larger than the $\delta$-weak eigenvalue condition numbers, introduced by Lotz and Noferini, of the original pencil. This not only indicates favorable numerical stability but also reconfirms that these condition numbers are a reliable criterion for detecting simple finite eigenvalues. We also provide evidence that, from a numerical stability perspective, the use of complex instead of real random matrices is preferable even for real singular matrix pencils and real eigenvalues. As a side result, we provide sharp left tail bounds for a product of two independent random variables distributed with the generalized beta distribution of the first kind or Kumaraswamy distribution.

Numerical Analysis
The Problem of Moments: A Bunch of Classical Results With Some Novelties

Pier Luigi Novi Inverardi,Aldo Tagliani,Jordan M. Stoyanov

2023-10-06

Abstract:We summarize significant classical results on (in)determinacy of measures in terms of their finite positive integer order moments. Well-known is the role of the smallest eigenvalues of Hankel matrices, starting from Hamburger's results a century ago and ending with the great progress made only in recent times by C. Berg and collaborators. We describe here known results containing necessary and sufficient conditions for moment (in)determinacy in both Hamburger and Stieltjes moment problems. In our exposition we follow an approach different from that commonly used. There are novelties well complementing the existing theory. Among them are: (a) to emphasize on the geometric interpretation of the indeterminacy conditions; (b) exploit fine properties of the eigenvalues of perturbed symmetric matrices allowing to derive new lower bounds for the smallest eigenvalues of Hankel matrices; these bounds are used for concluding indeterminacy; (c) provide new arguments to confirm classical results; (d) give new numerical illustrations involving commonly used probability distributions.

Functional Analysis
A Note on the Matrix Moment Problem and its Relation with Matrix Biorthogonal Polynomials

García-Ardila, Juan Carlos

DOI: https://doi.org/10.1007/s00025-024-02161-z

2024-04-20

Results in Mathematics

Abstract:In this manuscript, we study the operator moment problem for a block tridiagonal non-symmetric matrix. To study this problem, we used the relation between the resolvent function and a sequence of left-matrix orthogonal polynomials with respect to the sesquilinear form defined from the operator.

mathematics, applied
Lectures on the local semicircle law for Wigner matrices

Florent Benaych-Georges,Antti Knowles

DOI: https://doi.org/10.48550/arXiv.1601.04055

2018-09-10

Abstract:These notes provide an introduction to the local semicircle law from random matrix theory, as well as some of its applications. We focus on Wigner matrices, Hermitian random matrices with independent upper-triangular entries with zero expectation and constant variance. We state and prove the local semicircle law, which says that the eigenvalue distribution of a Wigner matrix is close to Wigner's semicircle distribution, down to spectral scales containing slightly more than one eigenvalue. This local semicircle law is formulated using the Green function, whose individual entries are controlled by large deviation bounds. We then discuss three applications of the local semicircle law: first, complete delocalization of the eigenvectors, stating that with high probability the eigenvectors are approximately flat; second, rigidity of the eigenvalues, giving large deviation bounds on the locations of the individual eigenvalues; third, a comparison argument for the local eigenvalue statistics in the bulk spectrum, showing that the local eigenvalue statistics of two Wigner matrices coincide provided the first four moments of their entries coincide. We also sketch further applications to eigenvalues near the spectral edge, and to the distribution of eigenvectors.

Probability,Mathematical Physics
Exchangeable arrays and integrable systems for characteristic polynomials of random matrices

Theodoros Assiotis,Mustafa Alper Gunes,Jonathan P. Keating,Fei Wei

2024-10-15

Abstract:The joint moments of the derivatives of the characteristic polynomial of a random unitary matrix, and also a variant of the characteristic polynomial that is real on the unit circle, in the large matrix size limit, have been studied intensively in the past twenty five years, partly in relation to conjectural connections to the Riemann zeta-function and Hardy's function. We completely settle the most general version of the problem of convergence of these joint moments, after they are suitably rescaled, for an arbitrary number of derivatives and with arbitrary positive real exponents. Our approach relies on a hidden, higher-order exchangeable structure, that of an exchangeable array. Using these probabilistic techniques, we then give a combinatorial formula for the leading order coefficient in the asymptotics of the joint moments, when the power on the characteristic polynomial itself is a positive real number and the exponents of the derivatives are integers, in terms of a finite number of finite-dimensional integrals which are explicitly computable. Finally, we develop a method, based on a class of Hankel determinants shifted by partitions, that allows us to give an exact representation of all these joint moments, for finite matrix size, in terms of derivatives of Painlevé V transcendents, and then for the leading order coefficient in the large-matrix limit in terms of derivatives of solutions of the $\sigma$-Painlevé III' equation. Equivalently, we can represent all the joint moments of power sum linear statistics of a certain determinantal point process behind this problem in terms of derivatives of $\sigma$-Painlevé III' transcendents. This gives an efficient way to compute all these quantities explicitly. Our methods can be used to obtain analogous results for a number of other models sharing the same features.

Probability,Mathematical Physics,Number Theory

Several applications of the moment method in random matrix theory

Randomized methods for computing joint eigenvalues, with applications to multiparameter eigenvalue problems and root finding

A Riemann--Hilbert approach to the perturbation theory for orthogonal polynomials: Applications to numerical linear algebra and random matrix theory

Infinite Random Matrix Theory, Tridiagonal Bordered Toeplitz Matrices, and the Moment Problem

Applications of multiple orthogonal polynomials with hypergeometric moment generating functions

Applications of the Hahn-Banach Theorem, a Solution of the Moment Problem and the Related Approximation

Real moments of the logarithmic derivative of characteristic polynomials in random matrix ensembles

Deriving Matrix Concentration Inequalities from Kernel Couplings

Approximating matrix eigenvalues by subspace iteration with repeated random sparsification

Concentration Inequalities for Sums of Markov Dependent Random Matrices

Applications of Moments of Dirichlet Coefficients in Elliptic Curve Families

Non-asymptotic theory of random matrices: extreme singular values

Important moments in systems, control and optimization

Multiple orthogonal polynomials in random matrix theory

Important Moments in Systems and Control

Numerically Stable Evaluation of Moments of Random Gram Matrices with Applications

Analysis of eigenvalue condition numbers for a class of randomized numerical methods for singular matrix pencils

The Problem of Moments: A Bunch of Classical Results With Some Novelties

A Note on the Matrix Moment Problem and its Relation with Matrix Biorthogonal Polynomials

Lectures on the local semicircle law for Wigner matrices

Exchangeable arrays and integrable systems for characteristic polynomials of random matrices