Abstract: In this work, a convergence lemma for function $f$ being finite compositions of analytic mappings and the maximum operator is proved. The lemma shows that the set of $\delta$-stationary points near an isolated local minimum point $x^*$ is shrinking to $x^*$ as $\delta\to 0$. It is a natural extension of the version for strongly convex $C^1$ functions. However, the correctness of the lemma is subtle. Analytic mappings are necessary for the lemma in the sense that replacing it with differentiable or $C^\infty$ mappings makes the lemma false. The proof is based on stratification theorems of semi-analytic sets by {\L}ojasiewicz. An extension of this proof presents a geometric characterization of the set of stationary points of $f$. Finally, a notion of stability on stationary points, called convergence stability, is proposed. It asks, under small numerical errors, whether a reasonable convergent optimization method started near a stationary point should eventually converge to the same stationary point. The concept of convergence stability becomes nontrivial qualitatively only when the objective function is both nonsmooth and nonconvex. Via the convergence lemma, an intuitive equivalent condition for convergence stability of $f$ is proved. These results together provide a new geometric perspective to study the problem of "where-to-converge" in nonsmooth nonconvex optimization.

On degenerate metric resolvent: well-definedness and new convergence analysis

Monotone vector fields and the proximal point algorithm on Hadamard manifolds

Resolvents of Set-Valued Monotone Vector Fields in Hadamard Manifolds

Convergence Criterion and Convergence Ball of the King-Werner Method under the Radius Lipschitz Condition

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Resolvent metrics and heat kernel estimates

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Non-Euclidean Monotone Operator Theory and Applications

On Convergence Lemma and Convergence Stability for Piecewise Analytic Functions

On the Fredholm determinant of the confluent hypergeometric kernel with discontinuities

Real Vector Cone Metric Space and Fixed Point Theorems

Convergence of local times of stochastic processes associated with resistance forms

Resolvent operator technique and iterative algorithms for system of generalized nonlinear variational inclusions and fixed point problems: Variational convergence with an application

On convergence of points to limiting processes, with an application to zeta zeros

The Semiclassical Resolvent on Conic Manifolds and Application to Schrödinger Equations

The splitting algorithms by Ryu and by Malitsky-Tam applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

Uniform stability and decay rate of solutions for fractional Cauchy problems

Nonlinear Resolvents and Decreasing Loewner Chains

On Convergence of Fixed Points in Fuzzy Metric Spaces

Resolvent and spectral measure for Schrödinger operators on flat Euclidean cones