Abstract:This paper considers the global geometry of general low-rank minimization problems via the Burer-Monterio factorization approach. For the rank-$1$ case, we prove that there is no spurious second-order critical point for both symmetric and asymmetric problems if the rank-$2$ RIP constant $\delta$ is less than $1/2$. Combining with a counterexample with $\delta=1/2$, we show that the derived bound is the sharpest possible. For the arbitrary rank-$r$ case, the same property is established when the rank-$2r$ RIP constant $\delta$ is at most $1/3$. We design a counterexample to show that the non-existence of spurious second-order critical points may not hold if $\delta$ is at least $1/2$. In addition, for any problem with $\delta$ between $1/3$ and $1/2$, we prove that all second-order critical points have a positive correlation to the ground truth. Finally, the strict saddle property, which can lead to the polynomial-time global convergence of various algorithms, is established for both the symmetric and asymmetric problems when the rank-$2r$ RIP constant $\delta$ is less than $1/3$. The results of this paper significantly extend several existing bounds in the literature.

Rank Equalities Related to Generalized Inverses of Matrices and Their Applications

Rank Equalities Related to a Class of Outer Generalized Inverse

A Rank Equality Of Matrices And Its Application

Generalized Inverses and a Block-Rank Equation.

Upper and lower bounds for the rank of the matrix-valued function when X has a fixed rank

Minimal Ranks of the Product of Generalized Inverses of Matrices

On the Open Problem Related to Rank Equalities for the Sum of Finitely Many Idempotent Matrices and Its Applications

Equalities for mixed operations of Moore–Penrose and group inverses of a matrix

Geometric rank of tensors and subrank of matrix multiplication

The Minimal Rank of Matrix Expressions with Respect to Hermitian Matrix-Revised

Constructions and characterizations of mixed reverse-order laws for the Moore–Penrose inverse and group inverse

Extremal Ranks of Matrix Expression of A - BXC with Respect to Hermitian Matrix.

Formulas for calculating the extremal ranks and inertias of a matrix-valued function subject to matrix equation restrictions

Equalities and inequalities for Hermitian solutions and Hermitian definite solutions of the two matrix equations $AX = B$ and $AXA^* = B$

On Rank Equalities of Partitioned Matrices over a Division Ring

Complete Rank Theorem in Advanced Calculus and Frobenius Theorem in Banach Space

Analysis of the properties of matrix rank and the relationship between matrix rank and matrix operations

Rank Equalities for Srew-idempotent Matrices

The Mixed Second Absorption Laws of the Sum of Two Matrices on Generalized Inverse

Lavoie Inequalities for Weighted Generalized Inverses of Matrices

General Low-rank Matrix Optimization: Geometric Analysis and Sharper Bounds