Abstract:We study the problem of determining if an input matrix A εRm x n can be well-approximated by a low rank matrix. Specifically, we study the problem of quickly estimating the rank or stable rank of A, the latter often providing a more robust measure of the rank. Since we seek significantly sublinear time algorithms, we cast these problems in the property testing framework. In this framework, A either has low rank or stable rank, or is far from having this property. The algorithm should read only a small number of entries or rows of A and decide which case A is in with high probability. If neither case occurs, the output is allowed to be arbitrary. We consider two notions of being far: (1) A requires changing at least an ε-fraction of its entries, or (2) A requires changing at least an ε-fraction of its rows. We call the former the "entry model" and the latter the "row model". We show: For testing if a matrix has rank at most d in the entry model, we improve the previous number of entries of A that need to be read from O(d2/ε2) (Krauthgamer and Sasson, SODA 2003) to O(d2/ε). Our algorithm is the first to adaptively query the entries of A, which for constant d we show is necessary to achieve O(1/ε) queries. For the important case of d = 1 we also give a new non-adaptive algorithm, improving the previous O(1/ε2) queries to O(log2(1/ε) / ε). For testing if a matrix has rank at most d in the row model, we prove an Ω(d/ε) lower bound on the number of rows that need to be read, even for adaptive algorithms. Our lower bound matches a non-adaptive upper bound of Krauthgamer and Sasson. For testing if a matrix has stable rank at most d in the row model or requires changing an ε/d-fraction of its rows in order to have stable rank at most d, we prove that reading θ(d/ε2) rows is necessary and sufficient. We also give an empirical evaluation of our rank and stable rank algorithms on real and synthetic datasets. For testing if a matrix has rank at most d in the entry model, we improve the previous number of entries of A that need to be read from O(d2/ε2) (Krauthgamer and Sasson, SODA 2003) to O(d2/ε). Our algorithm is the first to adaptively query the entries of A, which for constant d we show is necessary to achieve O(1/ε) queries. For the important case of d = 1 we also give a new non-adaptive algorithm, improving the previous O(1/ε2) queries to O(log2(1/ε) / ε). For testing if a matrix has rank at most d in the row model, we prove an Ω(d/ε) lower bound on the number of rows that need to be read, even for adaptive algorithms. Our lower bound matches a non-adaptive upper bound of Krauthgamer and Sasson. For testing if a matrix has stable rank at most d in the row model or requires changing an ε/d-fraction of its rows in order to have stable rank at most d, we prove that reading θ(d/ε2) rows is necessary and sufficient.

HODLR$d$D: A new Black-box fast algorithm for $N$-body problems in $d$-dimensions with guaranteed error bounds

HODLR3D: hierarchical matrices for N-body problems in three dimensions

New algebraic fast algorithms for $N$-body problems in two and three dimensions

Near-optimal hierarchical matrix approximation from matrix-vector products

Mixed precision HODLR matrices

Improved testing of low rank matrices

An $N \log N$ Parallel Fast Direct Solver for Kernel Matrices

Efficient and Scalable Kernel Matrix Approximations using Hierarchical Decomposition

Randomised methods for dynamical low-rank approximation

Stable rank-adaptive Dynamically Orthogonal Runge-Kutta schemes

On the numerical rank of radial basis function kernels in high dimension

A fast semi-direct least squares algorithm for hierarchically block separable matrices

Nonlinear Random Matrices and Applications to the Sum of Squares Hierarchy

Chasing Positive Bodies

Efficient Accelerated Coordinate Descent Methods and Faster Algorithms for Solving Linear Systems

A decoupled form of the structure-preserving doubling algorithm with low-rank structures

Scalable Algorithms for Locally Low-Rank Matrix Modeling

A Fast Algorithm for Rank-(L, M, N) Block Term Decomposition of Multi-Dimensional Data

Adaptive Low-Rank Methods: Problems on Sobolev Spaces

Adaptive multiplication of rank-structured matrices in linear complexity