Abstract:We present a fast algorithm for linear least squares problems governed by hierarchically block separable (HBS) matrices. Such matrices are generally dense but data-sparse and can describe many important operators including those derived from asymptotically smooth radial kernels that are not too oscillatory. The algorithm is based on a recursive skeletonization procedure that exposes this sparsity and solves the dense least squares problem as a larger, equality-constrained, sparse one. It relies on a sparse QR factorization coupled with iterative weighted least squares methods. In essence, our scheme consists of a direct component, comprised of matrix compression and factorization, followed by an iterative component to enforce certain equality constraints. At most two iterations are typically required for problems that are not too ill-conditioned. For an $M \times N$ HBS matrix with $M \geq N$ having bounded off-diagonal block rank, the algorithm has optimal $\mathcal{O} (M + N)$ complexity. If the rank increases with the spatial dimension as is common for operators that are singular at the origin, then this becomes $\mathcal{O} (M + N)$ in 1D, $\mathcal{O} (M + N^{3/2})$ in 2D, and $\mathcal{O} (M + N^{2})$ in 3D. We illustrate the performance of the method on both over- and underdetermined systems in a variety of settings, with an emphasis on radial basis function approximation and efficient updating and downdating.

Hierarchical interpolative factorization for elliptic operators: differential equations

Recursive sparse LU decomposition based on nested dissection and low rank approximations

Hierarchical Super-Localized Orthogonal Decomposition Method

Hierarchical Interpolative Factorization for Self Green's Function in 3D Modified Poisson-Boltzmann Equations

An L-DEIM Induced High Order Tensor Interpolatory Decomposition

Hierarchical Interpolative Factorization for Self Green’s Function in 3D Modified Poisson-Boltzmann Equations

A nested divide-and-conquer method for tensor Sylvester equations with positive definite hierarchically semiseparable coefficients

Adaptive finite element method for fractional differential equations using hierarchical matrices

Parallel Skeletonization for Integral Equations in Evolving Multiply-Connected Domains

A Fast Matrices Decomposition Algorithm for Two-Dimensional Elliptic Problem Using Legendre Spectral Collocation Approximation

Quasi-interpolation for the Helmholtz-Hodge decomposition

Efficient third order tensor-oriented directional splitting for exponential integrators

A fast semi-direct least squares algorithm for hierarchically block separable matrices

Interpolative Separable Density Fitting for Accelerating Two-Electron Integrals: A Theoretical Perspective.

Computing Functions of Symmetric Hierarchically Semiseparable Matrices

Solving high-dimensional Fokker-Planck equation with functional hierarchical tensor

Hierarchical Matrices Method and Its Application in Electromagnetic Integral Equations

Solving High-Dimensional Partial Integral Differential Equations: The Finite Expression Method

Fast and high-order approximation of parabolic equations using hierarchical direct solvers and implicit Runge-Kutta methods

Hierarchical LU Direct Solver Based on Higher Order Basis Function