Abstract:We consider nonsmooth rank-one symmetric matrix factorization. It has no spurious second-order stationary points.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is whether there are spurious second - order stationary points in the optimization problem of non - smooth rank - one symmetric matrix decomposition. Specifically, the author aims to prove that for a given vector \(u\in\mathbb{R}^n\), the function
\[
f:\mathbb{R}^n\rightarrow\mathbb{R}, \quad x\mapsto\frac{1}{2}\sum_{i,j = 1}^n|x_i x_j - u_i u_j|
\]
has no spurious second - order stationary points. Here, "spurious" means a stationary point that is not a global minimum.
### Problem Background and Motivation
1. **Research Background**:
- The non - smooth rank - one symmetric matrix decomposition problem has been a hot topic in the optimization field in recent years. It is closely related to fields such as low - rank matrix recovery and tensor decomposition.
- Six years ago, this problem was first studied as a limiting case of \(\ell_p\) rank - one symmetric tensor decomposition [5].
- Soon after, its global minimum was proven to be sharp [1, Theorem 8.6].
- Recently, this problem has attracted attention again because its saddle points are not strict [2].
2. **Research Motivation**:
- Understanding the optimization landscape of this type of optimization problem, especially whether there are spurious stationary points, is crucial for designing efficient optimization algorithms.
- If there are no spurious second - order stationary points, it means that any local optimization method may converge to the global optimal solution, thus simplifying the optimization process.
### Main Contributions
- **Main Result**: The main contribution of the paper is to prove that the above function \(f(x)\) has no spurious second - order stationary points. This provides a theoretical basis for understanding the optimization landscape of non - smooth rank - one symmetric matrix decomposition.
- **Proof Method**: The author uses tools and techniques in variational analysis, especially the classical chain rule when dealing with non - smooth functions, and combines it with a detailed analysis of the subdifferential.
Through these works, the author provides an important theoretical guarantee for the non - smooth rank - one symmetric matrix decomposition problem, which is helpful for further developing and applying related optimization algorithms.