Abstract:We study the problem of determining if an input matrix A εRm x n can be well-approximated by a low rank matrix. Specifically, we study the problem of quickly estimating the rank or stable rank of A, the latter often providing a more robust measure of the rank. Since we seek significantly sublinear time algorithms, we cast these problems in the property testing framework. In this framework, A either has low rank or stable rank, or is far from having this property. The algorithm should read only a small number of entries or rows of A and decide which case A is in with high probability. If neither case occurs, the output is allowed to be arbitrary. We consider two notions of being far: (1) A requires changing at least an ε-fraction of its entries, or (2) A requires changing at least an ε-fraction of its rows. We call the former the "entry model" and the latter the "row model". We show: For testing if a matrix has rank at most d in the entry model, we improve the previous number of entries of A that need to be read from O(d2/ε2) (Krauthgamer and Sasson, SODA 2003) to O(d2/ε). Our algorithm is the first to adaptively query the entries of A, which for constant d we show is necessary to achieve O(1/ε) queries. For the important case of d = 1 we also give a new non-adaptive algorithm, improving the previous O(1/ε2) queries to O(log2(1/ε) / ε). For testing if a matrix has rank at most d in the row model, we prove an Ω(d/ε) lower bound on the number of rows that need to be read, even for adaptive algorithms. Our lower bound matches a non-adaptive upper bound of Krauthgamer and Sasson. For testing if a matrix has stable rank at most d in the row model or requires changing an ε/d-fraction of its rows in order to have stable rank at most d, we prove that reading θ(d/ε2) rows is necessary and sufficient. We also give an empirical evaluation of our rank and stable rank algorithms on real and synthetic datasets. For testing if a matrix has rank at most d in the entry model, we improve the previous number of entries of A that need to be read from O(d2/ε2) (Krauthgamer and Sasson, SODA 2003) to O(d2/ε). Our algorithm is the first to adaptively query the entries of A, which for constant d we show is necessary to achieve O(1/ε) queries. For the important case of d = 1 we also give a new non-adaptive algorithm, improving the previous O(1/ε2) queries to O(log2(1/ε) / ε). For testing if a matrix has rank at most d in the row model, we prove an Ω(d/ε) lower bound on the number of rows that need to be read, even for adaptive algorithms. Our lower bound matches a non-adaptive upper bound of Krauthgamer and Sasson. For testing if a matrix has stable rank at most d in the row model or requires changing an ε/d-fraction of its rows in order to have stable rank at most d, we prove that reading θ(d/ε2) rows is necessary and sufficient.

Using oriented matroids to find low rank structure in presence of nonlinearity

The Bounds of Restricted Isometry Constants for Low Rank Matrices Recovery

Recovery of Low-Rank Matrices Based on the Rank Null Space Properties.

Low Rank Matrix Recovery with Adversarial Sparse Noise

Exploiting the Structure Effectively and Efficiently in Low Rank Matrix Recovery.

Noisy Low-rank Matrix Optimization: Geometry of Local Minima and Convergence Rate

On the geometric interpretation of the nonnegative rank

On the distance to low-rank matrices in the maximum norm

Enumerating Matroids and Linear Spaces

Estimation of high-dimensional low-rank matrices

Improved testing of low rank matrices

Data-Driven Linear Complexity Low-Rank Approximation of General Kernel Matrices: A Geometric Approach

Low-rank structure learning via nonconvex heuristic recovery.

Low solution rank of the matrix LASSO under RIP with consequences for rank-constrained algorithms

General Low-rank Matrix Optimization: Geometric Analysis and Sharper Bounds

Can Learning Be Explained By Local Optimality In Low-rank Matrix Recovery?

Minimizing low-rank models of high-order tensors: Hardness, span, tight relaxation, and applications

Exploring Algorithmic Limits of Matrix Rank Minimization under Affine Constraints

On the Asymptotic Nonnegative Rank of Matrices and its Applications in Information Theory

Euclidean Representation of Low-Rank Matrices and Its Geometric Properties

Metric Transforms and Low Rank Matrices via Representation Theory of the Real Hyperrectangle