Abstract:The matrix sensing problem is an important low-rank optimization problem that has found a wide range of applications, such as matrix completion, phase synchornization/retrieval, robust principal component analysis (PCA), and power system state estimation. In this work, we focus on the general matrix sensing problem with linear measurements that are corrupted by random noise. We investigate the scenario where the search rank r is equal to the true rank [Formula: see text] of the unknown ground truth (the exact parametrized case), as well as the scenario where r is greater than [Formula: see text] (the overparametrized case). We quantify the role of the restricted isometry property (RIP) in shaping the landscape of the nonconvex factorized formulation and assisting with the success of local search algorithms. First, we develop a global guarantee on the maximum distance between an arbitrary local minimizer of the nonconvex problem and the ground truth under the assumption that the RIP constant is smaller than [Formula: see text]. We then present a local guarantee for problems with an arbitrary RIP constant, which states that any local minimizer is either considerably close to the ground truth or far away from it. More importantly, we prove that this noisy, overparametrized problem exhibits the strict saddle property, which leads to the global convergence of perturbed gradient descent algorithm in polynomial time. The results of this work provide a comprehensive understanding of the geometric landscape of the matrix sensing problem in the noisy and overparametrized regime. Funding: This work was supported by grants from the National Science Foundation, Office of Naval Research, Air Force Office of Scientific Research, and Army Research Office.

Guarantees of Riemannian Optimization for Low Rank Matrix Recovery

CONVERGENCE AND STABILITY OF ITERATIVELY REWEIGHTED LEAST SQUARES FOR LOW-RANK MATRIXRECOVERY

On the Schatten P-Quasi-norm Minimization for Low-Rank Matrix Recovery

The Bounds of Restricted Isometry Constants for Low Rank Matrices Recovery

Convergence of projected Landweber iteration for matrix rank minimization

Convergence Analysis of Projected Gradient Descent for Schatten-p Nonconvex Matrix Recovery

Low-rank matrix recovery with non-quadratic loss: projected gradient method and regularity projection oracle

Convergence and stability of iteratively reweighted least squares for low-rank matrix recovery

Restricted -Isometry Properties of Nonconvex Matrix Recovery

Can Learning Be Explained By Local Optimality In Low-rank Matrix Recovery?

Exploiting the Structure Effectively and Efficiently in Low Rank Matrix Recovery.

Low-Rank Matrix Estimation from Rank-One Projections by Unlifted Convex Optimization

Sharp Global Guarantees for Nonconvex Low-Rank Matrix Recovery in the Overparameterized Regime

Improved Algorithms for Matrix Recovery from Rank-One Projections

Sharp Restricted Isometry Property Bounds for Low-rank Matrix Recovery Problems with Corrupted Measurements

Riemannian Optimization for Non-convex Euclidean Distance Geometry with Global Recovery Guarantees

Robust Recovery of Low-Rank Matrices Via Non-Convex Optimization

Geometric Analysis of Noisy Low-Rank Matrix Recovery in the Exact Parametrized and the Overparametrized Regimes

A Preconditioned Riemannian Gradient Descent Algorithm for Low-Rank Matrix Recovery

A Validation Approach to Over-parameterized Matrix and Image Recovery