Abstract:We consider stability issues in minimizing a continuous (probably parameterized, nonconvex and nonsmooth) real-valued function f . We call a point stationary if all its possible directional derivatives are nonnegative. In this work, we focus on two notions of stability on stationary points of f : parametric stability and convergence stability. Parametric considerations are widely studied in various ﬁelds, including smoothed analysis, numerical stability, condition numbers and sensitivity analysis for linear programming. Parametric stability asks whether minor perturbations on parameters lead to dramatic changes in the position and f value of a stationary point. Meanwhile, convergence stability indicates a non-escapable solution: Any point sequence iteratively produced by an optimization algorithm cannot escape from a neighborhood of a stationary point but gets close to it in the sense that such stationary points are stable to the precision parameter and algorithmic numerical errors. It turns out that these notions have deep connections to geometry theory. We show that parametric stability is linked to deformations of graphs of functions. On the other hand, convergence stability is concerned with area partitioning of the function domain. Utilizing these connections, we prove quite tight conditions of these two stability notions for a wide range of functions and optimization algorithms with small enough step sizes and precision parameters. These conditions are subtle in the sense that a slightly weaker function requirement goes to the opposite of primitive intuitions and leads to wrong conclusions. We present three applications of this theory. First, we provide a thorough analysis of parametric stability and convergence stability on the state-of-the-art approximation algorithm computing Nash equilibria in bi-matrix games, Tsaknakis-Spirakis (TS for

On Linear Stability of Parametric Convex Quadratic Programming

On Quadratic Stability of Discrete-time Interval 2-D Systems

On Quadratic Stability of Dynamic Interval Systems

Stabilizing control of robustness for systems with maximum uncertain parameters - A quadratic programming approach

Solving Convex Quadratic Programming by Potential-Reduction Interior-Point Algorithm

Robust Stabilization of Uncertain Hybrid Systems with Multiple Equilibria

Robust Stability of Hybrid Discrete Systems with Parameter Perturbation

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach

Local Stabilizing Control for Polynomial Nonlinear Systems

Convex parameterization approach for robust stabilization of systems with integral quadratic constrained uncertainties

Two-Stage Stochastic Programming with Linearly Bi-parameterized Quadratic Recourse.

Relaxed Stability Criteria for Time-Delay Systems: A Novel Quadratic Function Convex Approximation Approach

Quadratic convex reformulation for quadratic programming with linear on-off constraints.

Locally Lipschitz Stability of Solutions to a Parametric Parabolic Optimal Control Problem with Mixed Pointwise Constraints

Parametric Semidefinite Programming: Geometry of the Trajectory of Solutions

On Computing the Nonlinearity Interval in Parametric Semidefinite Optimization

Stable interior-point method for convex quadratic programming with strict error bounds

Stochastic Linear Quadratic Optimal Control with General Control Domain

Differential Stability Properties of Convex Optimization and Optimal Control Problems

Stabilization Of The Systems With Quadratic Constraint Uncertainties