Abstract:Partial eigenvalue decomposition (PEVD) and partial singular value decomposition (PSVD) of large sparse matrices are of fundamental importance in a wide range of applications, including latent semantic indexing, spectral clustering, and kernel methods for machine learning. The more challenging problems are when a large number of eigenpairs or singular triplets need to be computed. We develop practical and efficient algorithms for these challenging problems. Our algorithms are based on a filter-accelerated block Davidson method. Two types of filters are utilized, one is Chebyshev polynomial filtering, the other is rational-function filtering by solving linear equations. The former utilizes the fastest growth of the Chebyshev polynomial among same degree polynomials; the latter employs the traditional idea of shift-invert, for which we address the important issue of automatic choice of shifts and propose a practical method for solving the shifted linear equations inside the block Davidson method. Our two filters can efficiently generate high-quality basis vectors to augment the projection subspace at each Davidson iteration step, which allows a restart scheme using an active projection subspace of small dimension. This makes our algorithms memory-economical, thus practical for large PEVD/PSVD calculations. We compare our algorithms with representative methods, including ARPACK, PROPACK, the randomized SVD method, and the limited memory SVD method. Extensive numerical tests on representative datasets demonstrate that, in general, our methods have similar or faster convergence speed in terms of CPU time, while requiring much lower memory comparing with other methods. The much lower memory requirement makes our methods more practical for large-scale PEVD/PSVD computations.

Incremental Large-Scale Electrostatic Analysis

The Modified Solutoin for Large Sparse Symmetric Linear Systems in Electromagnetic Field Analysis

Generalized Krylov Recycling Methods For Solution Of Multiple Related Linear Equation Systems In Electromagnetic Analysis

An improved AMG-based method for fast power grid analysis

An Efficient Parallel Krylov-Schur Method for Eigen-Analysis of Large-Scale Power Systems

Fast Finite Element Electrostatic Analysis with Domain Decomposition Method

Localized Pseudo-Skeleton Approximation Method for Electromagnetic Analysis on Electrically Large Objects

A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

Combining the CORS and BiCORSTAB Iterative Methods with MLFMA and SAI Preconditioning for Solving Large Linear Systems in Electromagnetics

A New Iterative Technique for Large and Dense Linear Systems from the MEI Method in Electromagnetics

An Algorithmic Framework for Efficient Large-Scale Circuit Simulation Using Exponential Integrators

Solving Multi-Scale Low Frequency Electromagnetic Problems

Analysis of Electrically Large Problems Using the Augmented EFIE with a Calderón Preconditioner

Simulation of multiscale problems using equivalence principle algorithm

A Method for Solving Large Size Linear Algebraic Equations

Topology-aware Iterative Method for Large-scale Power Electronic Systems with Stray Parameters

Solving Large-Scale Eigenvalue Problems in Scidac Applications

Fast and Efficient Low-Frequency Algorithms for Multiscale Structure Modeling

Efficient Electromagnetic Scattering Simulation of Electrically Extra-Large Problems Using Phase Information and Adaptive Mesh Automation

A Domain Decomposition Finite-Difference Method Utilizing Characteristic Basis Functions for Solving Electrostatic Problems

Accelerating large partial EVD/SVD calculations by filtered block Davidson methods