Abstract:We consider stability issues in minimizing a continuous (probably parameterized, nonconvex and nonsmooth) real-valued function f . We call a point stationary if all its possible directional derivatives are nonnegative. In this work, we focus on two notions of stability on stationary points of f : parametric stability and convergence stability. Parametric considerations are widely studied in various ﬁelds, including smoothed analysis, numerical stability, condition numbers and sensitivity analysis for linear programming. Parametric stability asks whether minor perturbations on parameters lead to dramatic changes in the position and f value of a stationary point. Meanwhile, convergence stability indicates a non-escapable solution: Any point sequence iteratively produced by an optimization algorithm cannot escape from a neighborhood of a stationary point but gets close to it in the sense that such stationary points are stable to the precision parameter and algorithmic numerical errors. It turns out that these notions have deep connections to geometry theory. We show that parametric stability is linked to deformations of graphs of functions. On the other hand, convergence stability is concerned with area partitioning of the function domain. Utilizing these connections, we prove quite tight conditions of these two stability notions for a wide range of functions and optimization algorithms with small enough step sizes and precision parameters. These conditions are subtle in the sense that a slightly weaker function requirement goes to the opposite of primitive intuitions and leads to wrong conclusions. We present three applications of this theory. First, we provide a thorough analysis of parametric stability and convergence stability on the state-of-the-art approximation algorithm computing Nash equilibria in bi-matrix games, Tsaknakis-Spirakis (TS for

Primal characterizations of stability of error bounds for semi-infinite convex constraint systems in Banach spaces

Perturbation Analysis of Error Bounds for Convex Functions on Banach Spaces

Perturbation Analysis of Error Bounds for Quasi-subsmooth Inequalities and Semi-infinite Constraint Systems

Characterizations of Local and Global Error Bounds for Convex Inequalities in Banach Spaces

Perturbation of error bounds

Quantitative Analysis for Perturbed Abstract Inequality Systems in Banach Spaces

Stabilisation of a class of non-affine systems via modelling error compensation

Characterizations of Error Bounds for Convex Multifunctions on Banach Spaces

On Error Bounds of Inequalities in Asplund Spaces

Error Bounds for Approximate Solutions of Abstract Inequality Systems and Infinite Systems of Inequalities on Banach Spaces

Extension of Hoffman's Error Bound to Polynomial Systems

ON THE STABILITY THEORY IN NONCONVEX INFINITE OPTIMIZATION PROBLEMS

Porosity of perturbed optimization problems in Banach spaces

On Constraint Qualification for an Infinite System of Convex Inequalities in a Banach Space.

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach

On Global Error Bounds for Convex Inequalities Systems

Stability of Minima in Constrained Optimization Problems and Implicit Function Theorem

Error Bounds for Abstract Linear Inequality Systems

Relative Well-Posedness of Constrained Systems Accompanied by Variational Calculus

The Equivalence of Three Types of Error Bounds for Weakly and Approximately Convex Functions

Error bounds, PL condition, and quadratic growth for weakly convex functions, and linear convergences of proximal point methods