Abstract:We consider the approximation of the smallest eigenvalue of a large parameter-dependent Hermitian matrix over a continuum compact domain. Our approach is based on approximating the smallest eigenvalue by the one obtained by projecting the large matrix onto a suitable small subspace, a practice widely employed in the literature. The projection subspaces are constructed iteratively (to reduce the error of the approximation where it is large) with the addition of the eigenvectors of the parameter-dependent matrix at the parameter values where a surrogate error is maximal. The surrogate error is the gap between the approximation and a lower bound for the smallest eigenvalue proposed in [Sirkovic and Kressner, SIAM J. Matrix Anal. Appl., 37(2), 2016]. Unlike the classical approaches, such as the successive constraint method, that maximize such surrogate errors over a discrete and finite set, we maximize the surrogate error over the continuum of all permissible parameter values globally. We put particular attention to the lower bound, which enables us to formally prove the global convergence of our framework both in finite-dimensional and infinite-dimensional settings. In the second part, we focus on the approximation of the smallest singular value of a large parameter-dependent matrix, in case it is non-Hermitian, and propose another subspace framework to construct a small parameter-dependent non-Hermitian matrix whose smallest singular value approximates the original large-scale smallest singular value. We perform numerical experiments on synthetic examples, as well as on real examples arising from parametric PDEs. The numerical experiments show that the proposed techniques are able to drastically reduce the size of the large parameter-dependent matrix, while ensuring an approximation error for the smallest eigenvalue/singular value below the prescribed tolerance.

Measurability and continuity of parametric low-rank approximation in Hilbert spaces: linear operators and random variables

Optimal low-rank approximations of posteriors for linear Gaussian inverse problems on Hilbert spaces

Generalised rank-constrained approximations of Hilbert-Schmidt operators on separable Hilbert spaces and applications

Parametric PDEs: Sparse or Low-Rank Approximations?

A general error analysis for randomized low-rank approximation with application to data assimilation

On low-rank approximability of solutions to high-dimensional operator equations and eigenvalue problems

Randomized low-rank approximation of parameter-dependent matrices

Nonparametric Regression in Dirichlet Spaces: A Random Obstacle Approach

Refining uniform approximation algorithm for low-rank Chebyshev embeddings

Parametric/Stochastic Model Reduction: Low-Rank Representation, Non-Intrusive Bi-Fidelity Approximation, and Convergence Analysis

Efficient Algorithms for Regularized Nonnegative Scale-invariant Low-rank Approximation Models

Uniform Approximation of Eigenproblems of a Large-Scale Parameter-Dependent Hermitian Matrix

Randomized algorithms for low-rank matrix approximation: Design, analysis, and applications

Randomized Nyström approximation of non-negative self-adjoint operators

Geometric Analysis of Noisy Low-Rank Matrix Recovery in the Exact Parametrized and the Overparametrized Regimes

Low-Rank Approximation, Adaptation, and Other Tales

Kernel embedding of measures and low-rank approximation of integral operators

Low-rank approximations for large stationary covariance matrices, as used in the Bayesian and generalized-least-squares analysis of pulsar-timing data

Accelerated alternating minimization algorithm for low-rank approximations in the Chebyshev norm

On the approximation of vector-valued functions by volume sampling

An Approximation Theory for Metric Space-Valued Functions With A View Towards Deep Learning