Abstract:We consider stability issues in minimizing a continuous (probably parameterized, nonconvex and nonsmooth) real-valued function f . We call a point stationary if all its possible directional derivatives are nonnegative. In this work, we focus on two notions of stability on stationary points of f : parametric stability and convergence stability. Parametric considerations are widely studied in various ﬁelds, including smoothed analysis, numerical stability, condition numbers and sensitivity analysis for linear programming. Parametric stability asks whether minor perturbations on parameters lead to dramatic changes in the position and f value of a stationary point. Meanwhile, convergence stability indicates a non-escapable solution: Any point sequence iteratively produced by an optimization algorithm cannot escape from a neighborhood of a stationary point but gets close to it in the sense that such stationary points are stable to the precision parameter and algorithmic numerical errors. It turns out that these notions have deep connections to geometry theory. We show that parametric stability is linked to deformations of graphs of functions. On the other hand, convergence stability is concerned with area partitioning of the function domain. Utilizing these connections, we prove quite tight conditions of these two stability notions for a wide range of functions and optimization algorithms with small enough step sizes and precision parameters. These conditions are subtle in the sense that a slightly weaker function requirement goes to the opposite of primitive intuitions and leads to wrong conclusions. We present three applications of this theory. First, we provide a thorough analysis of parametric stability and convergence stability on the state-of-the-art approximation algorithm computing Nash equilibria in bi-matrix games, Tsaknakis-Spirakis (TS for

STABILITY OF APPROXIMATE OPTIMAL SOLUTIONS SETS AND CONTINUITY OF OPTIMAL VALUES OF PROBABILISTIC CONSTRAINED PROGRAMS

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

Reachability and Stabilization of Discrete-Time Affine Systems with Disturbances

Stability and Continuity in Robust Linear and Linear Semi-Infinite Optimization

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Continuity and Stability of Two-Stage Stochastic Programs with Quadratic Continuous Recourse

The stability of the solution sets for set optimization problems via improvement sets

Stabilization and Finite-Time Stabilization of Probabilistic Boolean Control Networks

Stabilizing control of robustness for systems with maximum uncertain parameters - A quadratic programming approach

Quantitative Stability of Mixed-Integer Two-Stage Quadratic Stochastic Programs

Continuity of the solutions sets for parametric set optimization problems

On Best Approximation by Nonconvex Sets and Perturbation of Nonconvex Inequality Systems in Hilbert Spaces.

Quantitative Analysis for Perturbed Abstract Inequality Systems in Banach Spaces

On quantitative stability in infinite-dimensional optimization under uncertainty

New Robust Optimization Approach Induced by Flexible Uncertainty Set: Optimization under Continuous Uncertainty

Solving Nonsmooth Nonconvex Compound Stochastic Programs with Applications to Risk Measure Minimization

Continuity and Stability of a Quadratic Mixed-Integer Stochastic Program

STABILITY OF A CLASS OF RISK-AVERSE MULTISTAGE STOCHASTIC PROGRAMS AND THEIR DISTRIBUTIONALLY ROBUST COUNTERPARTS

Quantitative Stability and Empirical Approximation of Risk-Averse Models Induced by Two-Stage Stochastic Programs with Full Random Recourse.

Optimal Approximation of Unique Continuation

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach