Abstract:The matrix sensing problem is an important low-rank optimization problem that has found a wide range of applications, such as matrix completion, phase synchornization/retrieval, robust principal component analysis (PCA), and power system state estimation. In this work, we focus on the general matrix sensing problem with linear measurements that are corrupted by random noise. We investigate the scenario where the search rank r is equal to the true rank [Formula: see text] of the unknown ground truth (the exact parametrized case), as well as the scenario where r is greater than [Formula: see text] (the overparametrized case). We quantify the role of the restricted isometry property (RIP) in shaping the landscape of the nonconvex factorized formulation and assisting with the success of local search algorithms. First, we develop a global guarantee on the maximum distance between an arbitrary local minimizer of the nonconvex problem and the ground truth under the assumption that the RIP constant is smaller than [Formula: see text]. We then present a local guarantee for problems with an arbitrary RIP constant, which states that any local minimizer is either considerably close to the ground truth or far away from it. More importantly, we prove that this noisy, overparametrized problem exhibits the strict saddle property, which leads to the global convergence of perturbed gradient descent algorithm in polynomial time. The results of this work provide a comprehensive understanding of the geometric landscape of the matrix sensing problem in the noisy and overparametrized regime. Funding: This work was supported by grants from the National Science Foundation, Office of Naval Research, Air Force Office of Scientific Research, and Army Research Office.

Matrix recovery from nonconvex regularized least absolute deviations

Low Rank Matrix Recovery with Adversarial Sparse Noise

CONVERGENCE AND STABILITY OF ITERATIVELY REWEIGHTED LEAST SQUARES FOR LOW-RANK MATRIXRECOVERY

On the Schatten P-Quasi-norm Minimization for Low-Rank Matrix Recovery

Convergence Analysis of Projected Gradient Descent for Schatten-p Nonconvex Matrix Recovery

Low-rank matrix estimation via nonconvex spectral regularized methods in errors-in-variables matrix regression

An Alternating Direction Method with Continuation for Nonconvex Low Rank Minimization

Low-rank matrix recovery with non-quadratic loss: projected gradient method and regularity projection oracle

Guaranteed matrix recovery using weighted nuclear norm plus weighted total variation minimization

Nonconvex relaxation approaches to robust matrix recovery

RIP-based Performance Guarantee for Low Rank Matrix Recovery via $L_{*-F}$ Minimization

Robust Recovery of Low-Rank Matrices Via Non-Convex Optimization

Joint Capped Norms Minimization for Robust Matrix Recovery

A Scalable, Adaptive and Sound Nonconvex Regularizer for Low-rank Matrix Learning

A Unified Variance Reduction-Based Framework for Nonconvex Low-Rank Matrix Recovery

A Validation Approach to Over-parameterized Matrix and Image Recovery

Sparse Recovery Via Nonconvex Regularized M-estimators over ℓ_q-Balls

Convergence and stability of iteratively reweighted least squares for low-rank matrix recovery

Geometric Analysis of Noisy Low-Rank Matrix Recovery in the Exact Parametrized and the Overparametrized Regimes

The Global Geometry of Centralized and Distributed Low-rank Matrix Recovery without Regularization

A multi-stage convex relaxation approach to noisy structured low-rank matrix recovery