Abstract:Matrix sketching is aimed at finding compact representations of a matrix while simultaneously preserving most of its properties, which is a fundamental building block in modern scientific computing. Randomized algorithms represent state-of-the-art and have attracted huge interest from the fields of machine learning, data mining, and theoretic computer science. However, it still requires the use of the entire input matrix in producing desired factorizations, which can be a major computational and memory bottleneck in truly large problems. In this paper, we uncover an interesting theoretic connection between matrix low-rank decomposition and lossy signal compression, based on which a cascaded compression sampling framework is devised to approximate an m-by-n matrix in only O(m+n) time and space. Indeed, the proposed method accesses only a small number of matrix rows and columns, which significantly improves the memory footprint. Meanwhile, by sequentially teaming two rounds of approximation procedures and upgrading the sampling strategy from a uniform probability to more sophisticated, encoding-orientated sampling, significant algorithmic boosting is achieved to uncover more granular structures in the data. Empirical results on a wide spectrum of real-world, large-scale matrices show that by taking only linear time and space, the accuracy of our method rivals those state-of-the-art randomized algorithms consuming a quadratic, O(mn), amount of resources.

Robust Matrix Completion with Deterministic Sampling via Convex Optimization

Matrix Completion with Deterministic Sampling: Theories and Methods

Matrix Completion with Nonuniform Sampling: Theories and Methods.

Robust Matrix Completion via Maximum Correntropy Criterion and Half Quadratic Optimization

Robust Matrix Completion With Column Outliers

Robust Matrix Completion Via Alternating Projection.

Information-Guided Sampling for Low-Rank Matrix Completion

On the Robustness of Cross-Concentrated Sampling for Matrix Completion

Adversarial Robust Low Rank Matrix Estimation: Compressed Sensing and Matrix Completion

Subspace projection matrix recovery from incomplete information

Robust Matrix Completion Based on Factorization and Truncated-Quadratic Loss Function

Randomization or Condensation?

Robust Discrete Matrix Completion.

Nonconvex Deterministic Matrix Completion by Projected Gradient Descent Methods

A Nearly Unbiased Matrix Completion Approach.

Scalable Robust Matrix Recovery: Frank-Wolfe Meets Proximal Methods

Nearly-optimal Robust Matrix Completion

Exact matrix completion via convex optimization

Nonconvex Robust High-Order Tensor Completion Using Randomized Low-Rank Approximation

Randomization or Condensation?: Linear-Cost Matrix Sketching Via Cascaded Compression Sampling.

Symmetric Matrix Completion with ReLU Sampling