Abstract:Partial eigenvalue decomposition (PEVD) and partial singular value decomposition (PSVD) of large sparse matrices are of fundamental importance in a wide range of applications, including latent semantic indexing, spectral clustering, and kernel methods for machine learning. The more challenging problems are when a large number of eigenpairs or singular triplets need to be computed. We develop practical and efficient algorithms for these challenging problems. Our algorithms are based on a filter-accelerated block Davidson method. Two types of filters are utilized, one is Chebyshev polynomial filtering, the other is rational-function filtering by solving linear equations. The former utilizes the fastest growth of the Chebyshev polynomial among same degree polynomials; the latter employs the traditional idea of shift-invert, for which we address the important issue of automatic choice of shifts and propose a practical method for solving the shifted linear equations inside the block Davidson method. Our two filters can efficiently generate high-quality basis vectors to augment the projection subspace at each Davidson iteration step, which allows a restart scheme using an active projection subspace of small dimension. This makes our algorithms memory-economical, thus practical for large PEVD/PSVD calculations. We compare our algorithms with representative methods, including ARPACK, PROPACK, the randomized SVD method, and the limited memory SVD method. Extensive numerical tests on representative datasets demonstrate that, in general, our methods have similar or faster convergence speed in terms of CPU time, while requiring much lower memory comparing with other methods. The much lower memory requirement makes our methods more practical for large-scale PEVD/PSVD computations.

A FEAST SVDsolver Based on Chebyshev–Jackson Series for Computing Partial Singular Triplets of Large Matrices

An Augmented Matrix-Based CJ-FEAST SVDsolver for Computing a Partial Singular Value Decomposition with the Singular Values in a Given Interval

A CJ-FEAST GSVDsolver for computing a partial GSVD of a large matrix pair with the generalized singular values in a given interval

A Contour Integral-Based Algorithm for Computing Generalized Singular Values

A Skew-Symmetric Lanczos Bidiagonalization Method for Computing Several Extremal Eigenpairs of a Large Skew-Symmetric Matrix

PRIMME_SVDS: A High-Performance Preconditioned SVD Solver for Accurate Large-Scale Computations

A parallel iterative method for solving symmetric tridiagonal extreme eigenpair problems

Using Cross-Product Matrices to Compute the SVD.

A Self-learning Algebraic Multigrid Method for Extremal Singular Triplets and Eigenpairs

Extended Newton-type Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

A Parallel Iterative Method For Solving Symmetrical Tridiagonal Extreme Eigenpair Problems

An Extended Ulm-like Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Accelerating large partial EVD/SVD calculations by filtered block Davidson methods

Accelerated singular value thresholding for matrix completion.

Fast computation of spectral densities for generalized eigenvalue problems

A Novel Fully Hardware-Implemented SVD Solver Based on Ultra-Parallel BCV Jacobi Algorithm

The Joint Bidiagonalization Method for Large GSVD Computations in Finite Precision.

An Inexact Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

An Ulm-like Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

A Refined Subspace Iteration Algorithm For Large Sparse Eigenproblems

A mixed precision Jacobi SVD algorithm