Abstract:Subset selection for the rank $k$ approximation of an $n\times d$ matrix $A$ offers improvements in the interpretability of matrices, as well as a variety of computational savings. This problem is well-understood when the error measure is the Frobenius norm, with various tight algorithms known even in challenging models such as the online model, where an algorithm must select the column subset irrevocably when the columns arrive one by one. In contrast, for other matrix losses, optimal trade-offs between the subset size and approximation quality have not been settled, even in the offline setting. We give a number of results towards closing these gaps. In the offline setting, we achieve nearly optimal bicriteria algorithms in two settings. First, we remove a $\sqrt k$ factor from a result of [SWZ19] when the loss function is any entrywise loss with an approximate triangle inequality and at least linear growth. Our result is tight for the $\ell_1$ loss. We give a similar improvement for entrywise $\ell_p$ losses for $p>2$, improving a previous distortion of $k^{1-1/p}$ to $k^{1/2-1/p}$. Our results come from a technique which replaces the use of a well-conditioned basis with a slightly larger spanning set for which any vector can be expressed as a linear combination with small Euclidean norm. We show that this technique also gives the first oblivious $\ell_p$ subspace embeddings for $1<p<2$ with $\tilde O(d^{1/p})$ distortion, which is nearly optimal and closes a long line of work. In the online setting, we give the first online subset selection algorithm for $\ell_p$ subspace approximation and entrywise $\ell_p$ low rank approximation by implementing sensitivity sampling online, which is challenging due to the sequential nature of sensitivity sampling. Our main technique is an online algorithm for detecting when an approximately optimal subspace changes substantially.

A sublinear-time randomized algorithm for column and row subset selection based on strong rank-revealing QR factorizations

Randomized Truncated Pivoted QLP Factorization for Low-Rank Matrix Recovery

A QLP Decomposition via Randomization.

Fair Column Subset Selection

Efficient Randomized Algorithms for the Fixed-Precision Low-Rank Matrix Approximation

New Subset Selection Algorithms for Low Rank Approximation: Offline and Online

An elementary approach to the problem of column selection in a rectangular matrix

A Random Algorithm for Low-Rank Decomposition of Large-Scale Matrices with Missing Entries

On Socially Fair Low-Rank Approximation and Column Subset Selection

Randomized Rank-Revealing QLP for Low-Rank Matrix Decomposition

CholeskyQR with Randomization and Pivoting for Tall Matrices (CQRRPT)

Interlacing Polynomial Method for the Column Subset Selection Problem

Randomized low-rank approximations beyond Gaussian random matrices

A randomized preconditioned Cholesky-QR algorithm

CUR Low Rank Approximation of a Matrix at Sublinear Cost

Column and row subset selection using nuclear scores: algorithms and theory for Nyström approximation, CUR decomposition, and graph Laplacian reduction

Single-pass randomized QLP decomposition for low-rank approximation

Low Rank Approximation of Binary Matrices: Column Subset Selection and Generalizations

On rank‐revealing QR factorizations of quaternion matrices

Interlacing Polynomial Method for Matrix Approximation via Generalized Column and Row Selection