Locating Eigenvalues of Symmetric Matrices - A Survey

Carlos Hoppen,David Jacobs,Vilmar Trevisan

DOI: https://doi.org/10.13001/ela.2024.7979

2024-01-19

Electronic Journal of Linear Algebra

Abstract:We survey algorithms for locating eigenvalues of symmetric matrices taking advantage of the underlying graph. We present applications in spectral graph theory.

mathematics

What problem does this paper attempt to address?

Bordering of Symmetric Matrices and an Application to the Minimum Number of Distinct Eigenvalues for the Join of Graphs

Aida Abiad,Shaun M. Fallat,Mark Kempton,Rupert H. Levene,Polona Oblak,Helena Šmigoc,Michael Tait,Kevin Vander Meulen

2023-08-31

Abstract:An important facet of the inverse eigenvalue problem for graphs is to determine the minimum number of distinct eigenvalues of a particular graph. We resolve this question for the join of a connected graph with a path. We then focus on bordering a matrix and attempt to control the change in the number of distinct eigenvalues induced by this operation. By applying bordering techniques to the join of graphs, we obtain numerous results on the nature of the minimum number of distinct eigenvalues as vertices are joined to a fixed graph.

Combinatorics
A Greedy Algorithm for Computing Eigenvalues of a Symmetric Matrix with Localized Eigenvectors

Taylor M. Hernandez,Roel Van Beeumen,Mark A. Caprio,Chao Yang

DOI: https://doi.org/10.1002/nla.2341

2020-01-01

Numerical Linear Algebra with Applications

Abstract:We present a greedy algorithm for computing selected eigenpairs of a large sparse matrixHthat can exploit localization features of the eigenvector. When the eigenvector to be computed is localized, meaning only a small number of its components have large magnitudes, the proposed algorithm identifies the location of these components in a greedy manner, and obtains approximations to the desired eigenpairs ofHby computing eigenpairs of a submatrix extracted from the corresponding rows and columns ofH. Even when the eigenvector is not completely localized, the approximate eigenvectors obtained by the greedy algorithm can be used as good starting guesses to accelerate the convergence of an iterative eigensolver applied toH. We discuss a few possibilities for selecting important rows and columns ofHand techniques for constructing good initial guesses for an iterative eigensolver using the approximate eigenvectors returned from the greedy algorithm. We demonstrate the effectiveness of this approach with examples from nuclear quantum many-body calculations, many-body localization studies of quantum spin chains and road network analysis.
A greedy algorithm for computing eigenvalues of a symmetric matrix

Hernandez Taylor M.,Van Beeumen Roel,Caprio Mark A.,Yang Chao

2019-01-01

Abstract: We present a greedy algorithm for computing selected eigenpairs of a large sparse matrix $H$ that can exploit localization features of the eigenvector. When the eigenvector to be computed is localized, meaning only a small number of its components have large magnitudes, the proposed algorithm identifies the location of these components in a greedy manner, and obtains approximations to the desired eigenpairs of $H$ by computing eigenpairs of a submatrix extracted from the corresponding rows and columns of $H$. Even when the eigenvector is not completely localized, the approximate eigenvectors obtained by the greedy algorithm can be used as good starting guesses to accelerate the convergence of an iterative eigensolver applied to $H$. We discuss a few possibilities for selecting important rows and columns of $H$ and techniques for constructing good initial guesses for an iterative eigensolver using the approximate eigenvectors returned from the greedy algorithm. We demonstrate the effectiveness of this approach with examples from nuclear quantum many-body calculations and many-body localization studies of quantum spin chains.
Conditions for eigenvalue configurations of two real symmetric matrices: a symmetric function approach

Hoon Hong,Daniel Profili,J. Rafael Sendra

2024-05-10

Abstract:For two real symmetric matrices, their eigenvalue configuration is the arrangement of their eigenvalues on the real line. We study the problem of determining a quantifier-free necessary and sufficient condition for two real symmetric matrices to realize a given eigenvalue configuration as a generalization of Descartes' rule of signs. We exploit the combinatorial properties of our definition for eigenvalue configuration to reduce a two-polynomial root counting problem into several single-polynomial root counting problems of symmetric polynomials. We then leverage the fundamental theorem of symmetric polynomials to derive a final quantifier-free necessary and sufficient condition for two real symmetric matrices to realize a given eigenvalue configuration.

Algebraic Geometry,Symbolic Computation
The Multivariate Eigenvalues of Symmetric Tensors

Anwa Zhou,Yangyang Ni,Jinyan Fan

DOI: https://doi.org/10.1137/23m1614808

IF: 1.908

2024-10-19

SIAM Journal on Matrix Analysis and Applications

Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 4, Page 1954-1977, December 2024. This paper studies the multivariate eigenvalue problem for symmetric tensor tuples. Basic properties of the multivariate eigenvalues are given. It is shown that both the numbers of the complex multivariate eigenvalues and eigenvectors of symmetric tensor tuples are finite in general. We formulate the tensor multivariate eigenvalue problem equivalently as polynomial optimization. The real multivariate eigenvalues can be computed sequentially. Each of them can be computed by Lasserre's hierarchy of semidefinite relaxations. We show that it has finite convergence for generic symmetric tensor tuples. Numerical experiments are presented to show the efficiency of the proposed method.

mathematics, applied
Inverse eigenvalue and related problems for hollow matrices described by graphs

F. Scott Dahlgren,Zachary Gershkoff,Leslie Hogben,Sara Motlaghian,Derek Young

DOI: https://doi.org/10.13001/ela.2022.6941

2022-10-22

Abstract:A hollow matrix described by a graph $G$ is a real symmetric matrix having all diagonal entries equal to zero and with the off-diagonal entries governed by the adjacencies in $G$. For a given graph $G$, the determination of all possible spectra of matrices associated with $G$ is the hollow inverse eigenvalue problem for $G$. Solutions to the hollow inverse eigenvalue problems for paths and complete bipartite graphs are presented. Results for related subproblems such as possible ordered multiplicity lists, maximum multiplicity of an eigenvalue, and minimum number of distinct eigenvalues are presented for additional families of graphs.

mathematics
A Communication-Avoiding Parallel Algorithm for the Symmetric Eigenvalue Problem

Edgar Solomonik,Grey Ballard,James Demmel,Torsten Hoefler

DOI: https://doi.org/10.1145/3087556.3087561

2017-07-24

Abstract:Many large-scale scientific computations require eigenvalue solvers in a scaling regime where efficiency is limited by data movement. We introduce a parallel algorithm for computing the eigenvalues of a dense symmetric matrix, which performs asymptotically less communication than previously known approaches. We provide analysis in the Bulk Synchronous Parallel (BSP) model with additional consideration for communication between a local memory and cache. Given sufficient memory to store c copies of the symmetric matrix, our algorithm requires \Theta(\sqrt{c}) less interprocessor communication than previously known algorithms, for any c\leq p^{1/3} when using p processors. The algorithm first reduces the dense symmetric matrix to a banded matrix with the same eigenvalues. Subsequently, the algorithm employs successive reduction to O(\log p) thinner banded matrices. We employ two new parallel algorithms that achieve lower communication costs for the full-to-band and band-to-band reductions. Both of these algorithms leverage a novel QR factorization algorithm for rectangular matrices.
Eigenvector components of symmetric, graph-related matrices

P. Van Mieghem

DOI: https://doi.org/10.1016/j.laa.2024.03.035

IF: 1.307

2024-03-31

Linear Algebra and its Applications

Abstract:Although eigenvectors belong to the core of linear algebra, relatively few closed-form expressions exist, which we bundle and discuss here. A particular goal is their interpretation for graph-related matrices, such as the adjacency matrix of an undirected, possibly weighted graph.

mathematics, applied
Extremal inverse eigenvalue problem for matrices described by a connected unicyclic graph

Bijoya Bardhan,Mausumi Sen,Debashish Sharma

DOI: https://doi.org/10.21136/am.2024.0084-23

2024-02-15

Applications of Mathematics

Abstract:In this paper, we deal with the construction of symmetric matrix whose corresponding graph is connected and unicyclic using some pre-assigned spectral data. Spectral data for the problem consist of the smallest and the largest eigenvalues of each leading principal submatrices. Inverse eigenvalue problem (IEP) with this set of spectral data is generally known as the extremal IEP. We use a standard scheme of labeling the vertices of the graph, which helps in getting a simple relation between the characteristic polynomials of each leading principal submatrix. Sufficient condition for the existence of the solution is obtained. The proof is constructive, hence provides an algorithmic procedure for finding the required matrix. Furthermore, we provide the condition under which the same problem is solvable when two particular entries of the required matrix satisfy a linear relation.

mathematics, applied
A Multilevel Spectral Indicator Method for Eigenvalues of Large Non-Hermitian Matrices

Ruihao Huang,Jiguang Sun,Chao Yang

DOI: https://doi.org/10.4208/CSIAM-AM.2020-0021

2020-01-01

CSIAM Transactions on Applied Mathematics

Abstract:Recently a novel family of eigensolvers, called spectral indicator methods (SIMs), was proposed. Given a region on the complex plane, SIMs first compute an indicator by the spectral projection. The indicator is used to test if the region contains eigenvalue(s). Then the region containing eigenvalues(s) is subdivided and tested. The procedure is repeated until the eigenvalues are identified within a specified precision. In this paper, using Cayley transformation and Krylov subspaces, a memory efficient multilevel eigensolver is proposed. The method uses less memory compared with the early versions of SIMs and is particularly suitable to compute many eigenvalues of large sparse (non-Hermitian) matrices. Several examples are presented for demonstration.
Spectral Theory of Sparse Non-Hermitian Random Matrices

Fernando Lucas Metz,Izaak Neri,Tim Rogers

DOI: https://doi.org/10.1088/1751-8121/ab1ce0

2024-02-20

Abstract:Sparse non-Hermitian random matrices arise in the study of disordered physical systems with asymmetric local interactions, and have applications ranging from neural networks to ecosystem dynamics. The spectral characteristics of these matrices provide crucial information on system stability and susceptibility, however, their study is greatly complicated by the twin challenges of a lack of symmetry and a sparse interaction structure. In this review we provide a concise and systematic introduction to the main tools and results in this field. We show how the spectra of sparse non-Hermitian matrices can be computed via an analogy with infinite dimensional operators obeying certain recursion relations. With reference to three illustrative examples -- adjacency matrices of regular oriented graphs, adjacency matrices of oriented Erdős-Rényi graphs, and adjacency matrices of weighted oriented Erdős-Rényi graphs -- we demonstrate the use of these methods to obtain both analytic and numerical results for the spectrum, the spectral distribution, the location of outlier eigenvalues, and the statistical properties of eigenvectors.

Statistical Mechanics,Disordered Systems and Neural Networks,Mathematical Physics
Inverse eigenvalue problem for Laplacian matrices of a graph

Shaun Fallat,Himanshu Gupta,Jephian C.-H. Lin

2024-11-01

Abstract:For a given graph $G$, we aim to determine the possible realizable spectra for a generalized (or sometimes referred to as a weighted) Laplacian matrix associated with $G$. This specialized inverse eigenvalue problem is considered for certain families of graphs and graphs on a small number of vertices. Related considerations include studying the possible ordered multiplicity lists associated with stars and complete graphs and graphs with a few vertices. Finally, we investigate the both theoretically and numerically, the minimum variance over a family of generalized Laplacian matrices with a size-normalized weighting.

Combinatorics
Conditions for eigenvalue configurations of two real symmetric matrices: a signature approach

Hoon Hong,Daniel Profili,J. Rafael Sendra

2024-05-10

Abstract:For two real symmetric matrices, their eigenvalue configuration is the arrangement of their eigenvalues on the real line. In this paper, we provide quantifier-free necessary and sufficient conditions for two symmetric matrices to realize a given eigenvalue configuration. The basic idea is to generate a set of polynomials in the entries of the two matrices whose roots can be counted to uniquely determine the eigenvalue configuration. This result can be seen as ageneralization of Descartes' rule of signs to the case of two real univariate polynomials.

Algebraic Geometry,Symbolic Computation
Real Symmetric Matrices with Partitioned Eigenvalues

Madeleine Weinstein

DOI: https://doi.org/10.48550/arXiv.2008.08554

2021-10-12

Abstract:We study the real algebraic variety of real symmetric matrices with eigenvalue multiplicities determined by a partition. We present formulas for the dimension and Euclidean distance degree. We give a parametrization by rational functions. For small matrices, we provide equations; for larger matrices, we explain how to use representation theory to find equations. We describe the ring of invariants under the action of the orthogonal group. For the subvariety of diagonal matrices, we give the degree.

Algebraic Geometry,Representation Theory
The eigenvalue spectrum of a large real antisymmetric random matrix with non-zero mean

Andrei Katsevich,Pavel Meshcheriakov

2023-09-05

Abstract:We study the eigenvalue spectrum of a large real antisymmetric random matrix $J_{ij}$. Using a fermionic approach and replica trick, we obtain a semicircular spectrum of eigenvalues when the mean value of each matrix element is zero, and in the case of a non-zero mean, we show that there is a set of critical finite mean values above which eigenvalues arise that are split off from the semicircular continuum of eigenvalues. The result converged with numerical simulations.

High Energy Physics - Theory,Disordered Systems and Neural Networks
Gradient-type subspace iteration methods for the symmetric eigenvalue problem

Foivos Alimisis,Yousef Saad,Bart Vandereycken

2024-05-12

Abstract:This paper explores variants of the subspace iteration algorithm for computing approximate invariant subspaces. The standard subspace iteration approach is revisited and new variants that exploit gradient-type techniques combined with a Grassmann manifold viewpoint are developed. A gradient method as well as a nonlinear conjugate gradient technique are described. Convergence of the gradient-based algorithm is analyzed and a few numerical experiments are reported, indicating that the proposed algorithms are sometimes superior to standard algorithms. This includes the Chebyshev-based subspace iteration and the locally optimal block conjugate gradient method, when compared in terms of number of matrix vector products and computational time, resp. The new methods, on the other hand, do not require estimating optimal parameters. An important contribution of this paper to achieve this good performance is the accurate and efficient implementation of an exact line search. In addition, new convergence proofs are presented for the non-accelerated gradient method that includes a locally exponential convergence if started in a $\mathcal{O(\sqrt{\delta})}$ neighbourhood of the dominant subspace with spectral gap $\delta$.

Numerical Analysis,Optimization and Control
A note on constructing a symmetric matrix with specified diagonal entries and eigenvalues

Hongyuan Zha,Zhenyue Zhang

DOI: https://doi.org/10.1007/BF01732616

1995-01-01

BIT

Abstract:A finite step algorithm is given such that for any two vectorsa, λ ∈R n witha majorized by λ, it computes a symmetric matrixH ∈R n x n with the elements ofa and λ as its diagonal entries and eigenvalues, respectively.
Delocalized eigenvectors of transitive graphs and beyond

Nicolas Burq,Cyril Letrouit

2024-07-17

Abstract:We prove delocalization of eigenvectors of vertex-transitive graphs via elementary estimates of the spectral projector. We recover in this way known results which were formerly proved using representation theory.Similar techniques show that for general symmetric matrices, most approximate eigenvectors spectrally localized in a given window containing sufficiently many eigenvalues are delocalized in $L^q$ norms. Building upon this observation, we prove a delocalization result for approximate eigenvectors of large graphs containing few short loops, under an assumption on the resolvent which is verified in some standard cases, for instance random lifts of a fixed base graph.

Spectral Theory
Computing the k-th Eigenvalue of Symmetric $H^2$-Matrices

M. Ridwan Apriansyah,Rio Yokota

DOI: https://doi.org/10.1145/3605573.3605607

2023-11-15

Abstract:The numerical solution of eigenvalue problems is essential in various application areas of scientific and engineering domains. In many problem classes, the practical interest is only a small subset of eigenvalues so it is unnecessary to compute all of the eigenvalues. Notable examples are the electronic structure problems where the $k$-th smallest eigenvalue is closely related to the electronic properties of materials. In this paper, we consider the $k$-th eigenvalue problems of symmetric dense matrices with low-rank off-diagonal blocks. We present a linear time generalized LDL decomposition of $\mathcal{H}^2$ matrices and combine it with the bisection eigenvalue algorithm to compute the $k$-th eigenvalue with controllable accuracy. In addition, if more than one eigenvalue is required, some of the previous computations can be reused to compute the other eigenvalues in parallel. Numerical experiments show that our method is more efficient than the state-of-the-art dense eigenvalue solver in LAPACK/ScaLAPACK and ELPA. Furthermore, tests on electronic state calculations of carbon nanomaterials demonstrate that our method outperforms the existing HSS-based bisection eigenvalue algorithm on 3D problems.

Numerical Analysis
Eigenvalues of real symmetric matrices

Meinolf Geck

DOI: https://doi.org/10.48550/arXiv.1406.0259

2014-06-02

Abstract:We present a proof of the existence of real eigenvalues of real symmetric matrices which does not rely on any limit or compactness arguments, but only uses the notions of "sup", "inf".

History and Overview

Locating Eigenvalues of Symmetric Matrices - A Survey

Bordering of Symmetric Matrices and an Application to the Minimum Number of Distinct Eigenvalues for the Join of Graphs

A Greedy Algorithm for Computing Eigenvalues of a Symmetric Matrix with Localized Eigenvectors

A greedy algorithm for computing eigenvalues of a symmetric matrix

Conditions for eigenvalue configurations of two real symmetric matrices: a symmetric function approach

The Multivariate Eigenvalues of Symmetric Tensors

Inverse eigenvalue and related problems for hollow matrices described by graphs

A Communication-Avoiding Parallel Algorithm for the Symmetric Eigenvalue Problem

Eigenvector components of symmetric, graph-related matrices

Extremal inverse eigenvalue problem for matrices described by a connected unicyclic graph

A Multilevel Spectral Indicator Method for Eigenvalues of Large Non-Hermitian Matrices

Spectral Theory of Sparse Non-Hermitian Random Matrices

Inverse eigenvalue problem for Laplacian matrices of a graph

Conditions for eigenvalue configurations of two real symmetric matrices: a signature approach

Real Symmetric Matrices with Partitioned Eigenvalues

The eigenvalue spectrum of a large real antisymmetric random matrix with non-zero mean

Gradient-type subspace iteration methods for the symmetric eigenvalue problem

A note on constructing a symmetric matrix with specified diagonal entries and eigenvalues

Delocalized eigenvectors of transitive graphs and beyond

Computing the k-th Eigenvalue of Symmetric $H^2$-Matrices

Eigenvalues of real symmetric matrices