Abstract:We consider stability issues in minimizing a continuous (probably parameterized, nonconvex and nonsmooth) real-valued function f . We call a point stationary if all its possible directional derivatives are nonnegative. In this work, we focus on two notions of stability on stationary points of f : parametric stability and convergence stability. Parametric considerations are widely studied in various ﬁelds, including smoothed analysis, numerical stability, condition numbers and sensitivity analysis for linear programming. Parametric stability asks whether minor perturbations on parameters lead to dramatic changes in the position and f value of a stationary point. Meanwhile, convergence stability indicates a non-escapable solution: Any point sequence iteratively produced by an optimization algorithm cannot escape from a neighborhood of a stationary point but gets close to it in the sense that such stationary points are stable to the precision parameter and algorithmic numerical errors. It turns out that these notions have deep connections to geometry theory. We show that parametric stability is linked to deformations of graphs of functions. On the other hand, convergence stability is concerned with area partitioning of the function domain. Utilizing these connections, we prove quite tight conditions of these two stability notions for a wide range of functions and optimization algorithms with small enough step sizes and precision parameters. These conditions are subtle in the sense that a slightly weaker function requirement goes to the opposite of primitive intuitions and leads to wrong conclusions. We present three applications of this theory. First, we provide a thorough analysis of parametric stability and convergence stability on the state-of-the-art approximation algorithm computing Nash equilibria in bi-matrix games, Tsaknakis-Spirakis (TS for

Geometric characterizations of Lipschitz stability for convex optimization problems

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach

Locally Lipschitz Stability of Solutions to a Parametric Parabolic Optimal Control Problem with Mixed Pointwise Constraints

STABLE LAGRANGE DUALITIES FOR ROBUST CONICAL PROGRAMMING

Stable and Total Fenchel Duality for Convex Optimization Problems in Locally Convex Spaces

Geometric characterizations for strong minima with applications to nuclear norm minimization problems

Optimality conditions and Lipschitz stability for non-smooth semilinear elliptic optimal control problems with sparse controls

Lipschitz stability of least-squares problems regularized by functions with $\mathcal{C}^2$-cone reducible conjugates

Differential Stability Properties of Convex Optimization and Optimal Control Problems

Decomposition Method for Lipschitz Stability of General LASSO-type Problems

Weak sharp minima at infinity and solution stability in mathematical programming via asymptotic analysis

Quantitative Stability in the Geometry of Semi-discrete Optimal Transport

Stability Analysis for Parametric Mathematical Programs with Geometric Constraints and Its Applications.

A semiconcavity approach to stability of entropic plans and exponential convergence of Sinkhorn's algorithm

Stability of Nonhomogeneous Split Equality and Split Feasibility Problems with Possibly Nonconvex Constraint Sets

On Convergence Lemma and Convergence Stability for Piecewise Analytic Functions

Stability Criteria and Calculus Rules via Conic Contingent Coderivatives in Banach Spaces

Stability of first-order methods in tame optimization

Clarke's tangent cones, subgradients, optimality conditions and the Lipschitzness at infinity

Lipschitz minimization and the Goldstein modulus