Nonsmooth rank-one symmetric matrix factorization landscape

Cédric Josz,Lexiao Lai
2024-10-23
Abstract:We consider nonsmooth rank-one symmetric matrix factorization. It has no spurious second-order stationary points.
Optimization and Control
What problem does this paper attempt to address?
The problem that this paper attempts to solve is whether there are spurious second - order stationary points in the optimization problem of non - smooth rank - one symmetric matrix decomposition. Specifically, the author aims to prove that for a given vector \(u\in\mathbb{R}^n\), the function \[ f:\mathbb{R}^n\rightarrow\mathbb{R}, \quad x\mapsto\frac{1}{2}\sum_{i,j = 1}^n|x_i x_j - u_i u_j| \] has no spurious second - order stationary points. Here, "spurious" means a stationary point that is not a global minimum. ### Problem Background and Motivation 1. **Research Background**: - The non - smooth rank - one symmetric matrix decomposition problem has been a hot topic in the optimization field in recent years. It is closely related to fields such as low - rank matrix recovery and tensor decomposition. - Six years ago, this problem was first studied as a limiting case of \(\ell_p\) rank - one symmetric tensor decomposition [5]. - Soon after, its global minimum was proven to be sharp [1, Theorem 8.6]. - Recently, this problem has attracted attention again because its saddle points are not strict [2]. 2. **Research Motivation**: - Understanding the optimization landscape of this type of optimization problem, especially whether there are spurious stationary points, is crucial for designing efficient optimization algorithms. - If there are no spurious second - order stationary points, it means that any local optimization method may converge to the global optimal solution, thus simplifying the optimization process. ### Main Contributions - **Main Result**: The main contribution of the paper is to prove that the above function \(f(x)\) has no spurious second - order stationary points. This provides a theoretical basis for understanding the optimization landscape of non - smooth rank - one symmetric matrix decomposition. - **Proof Method**: The author uses tools and techniques in variational analysis, especially the classical chain rule when dealing with non - smooth functions, and combines it with a detailed analysis of the subdifferential. Through these works, the author provides an important theoretical guarantee for the non - smooth rank - one symmetric matrix decomposition problem, which is helpful for further developing and applying related optimization algorithms.