Abstract:We consider stability issues in minimizing a continuous (probably parameterized, nonconvex and nonsmooth) real-valued function f . We call a point stationary if all its possible directional derivatives are nonnegative. In this work, we focus on two notions of stability on stationary points of f : parametric stability and convergence stability. Parametric considerations are widely studied in various ﬁelds, including smoothed analysis, numerical stability, condition numbers and sensitivity analysis for linear programming. Parametric stability asks whether minor perturbations on parameters lead to dramatic changes in the position and f value of a stationary point. Meanwhile, convergence stability indicates a non-escapable solution: Any point sequence iteratively produced by an optimization algorithm cannot escape from a neighborhood of a stationary point but gets close to it in the sense that such stationary points are stable to the precision parameter and algorithmic numerical errors. It turns out that these notions have deep connections to geometry theory. We show that parametric stability is linked to deformations of graphs of functions. On the other hand, convergence stability is concerned with area partitioning of the function domain. Utilizing these connections, we prove quite tight conditions of these two stability notions for a wide range of functions and optimization algorithms with small enough step sizes and precision parameters. These conditions are subtle in the sense that a slightly weaker function requirement goes to the opposite of primitive intuitions and leads to wrong conclusions. We present three applications of this theory. First, we provide a thorough analysis of parametric stability and convergence stability on the state-of-the-art approximation algorithm computing Nash equilibria in bi-matrix games, Tsaknakis-Spirakis (TS for

Asymptotic expansions of stable, stabilizable and stabilized means with applications

Asymptotic expansions of stable, stabilizable and stabilized means with applications

Results on comparison and sub/super-stabilizability of some new means

Mean square asymptotic stability characterisation of perturbed linear stochastic functional differential equations

Iterations of mean-type mappings and their convergence

Stability analysis and dynamical behavior of optimal mean-based iterative methods

Nonlinear asymptotic mean value characterizations of holomorphic functions

Uniform bounds for robust mean estimators

Some Approximation Properties by Szász-P{ă}lt{ă}nea type Operators involving the Appell Polynomials of class $A^2$

Asymptotic permutation tests for coefficients of variation and standardised means in general one-way ANOVA models

Asymptotic expansion for some local volatility models arising in finance

Exact Calculation of the Mean-Square Error in the Method of Expansion of Iterated Ito Stochastic integrals Based on Generalized Multiple Fourier Series

Asymptotic Expansions and two-sided Bounds in Randomized Central Limit Theorems

Asymptotic behaviour of determinants through the expansion of the Moyal star product

Asymptotic normality of spectral means of Hilbert space valued random processes

Asymptotics of mean value points: a survey

Concentration inequalities for locally small increments of compound empirical processes with applications to solutions of compound and risk averse stochastical programming

Weak sharp minima at infinity and solution stability in mathematical programming via asymptotic analysis

Asymptotic expansions for the linear PDEs with oscillatory input terms; Analytical form and error analysis

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach