Abstract:We consider stability issues in minimizing a continuous (probably parameterized, nonconvex and nonsmooth) real-valued function f . We call a point stationary if all its possible directional derivatives are nonnegative. In this work, we focus on two notions of stability on stationary points of f : parametric stability and convergence stability. Parametric considerations are widely studied in various ﬁelds, including smoothed analysis, numerical stability, condition numbers and sensitivity analysis for linear programming. Parametric stability asks whether minor perturbations on parameters lead to dramatic changes in the position and f value of a stationary point. Meanwhile, convergence stability indicates a non-escapable solution: Any point sequence iteratively produced by an optimization algorithm cannot escape from a neighborhood of a stationary point but gets close to it in the sense that such stationary points are stable to the precision parameter and algorithmic numerical errors. It turns out that these notions have deep connections to geometry theory. We show that parametric stability is linked to deformations of graphs of functions. On the other hand, convergence stability is concerned with area partitioning of the function domain. Utilizing these connections, we prove quite tight conditions of these two stability notions for a wide range of functions and optimization algorithms with small enough step sizes and precision parameters. These conditions are subtle in the sense that a slightly weaker function requirement goes to the opposite of primitive intuitions and leads to wrong conclusions. We present three applications of this theory. First, we provide a thorough analysis of parametric stability and convergence stability on the state-of-the-art approximation algorithm computing Nash equilibria in bi-matrix games, Tsaknakis-Spirakis (TS for

Stability for Nash Equilibrium Problems

Robust Stabilization for a Class of Nonlinear Networked Control Systems

Necessary and sufficient optimality conditions for nonsmooth nonconvex generalized Nash equilibrium problems

Strong calmness of perturbed KKT system for a class of conic programming with degenerate solutions

Input-to-State Stability of Newton Methods in Nash Equilibrium Problems with Applications to Game-Theoretic Model Predictive Control

The robust isolated calmness of spectral norm regularized convex matrix optimization problems

Generalized Nash equilibrium problems with quasi-linear constraints

Necessary and sufficient conditions for strong stability of explicit Runge-Kutta methods

Nash Equilibrium Seeking for Noncooperative Duopoly Games via Event-Triggered Control

Global Nash Equilibrium in Non-convex Multi-player Game: Theory and Algorithms

Hierarchical Nash Equilibrium over Variational Equilibria via Fixed-point Set Expression of Quasi-nonexpansive Operator

Full Stability for Variational Nash Equilibriums of Parametric Optimal Control Problems of PDEs

Equilibrium modeling and solution approaches inspired by nonconvex bilevel programming

Generalized Nash Equilibrium from a Robustness Perspective in Variational Analysis

Approaching the Global Nash Equilibrium of Non-convex Multi-player Games

Stability of networked evolutionary games with payoff perturbation

Isolated calmness of perturbation mappings in generalized nonlinear programming and local superlinear convergence of Newton-type methods

Nash Equilibrium Seeking for General Linear Systems with Disturbance Rejection

An Improved Two-Step Method for Solving Generalized Nash Equilibrium Problems.

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach

Stability Analysis of Optimization Problems with $k$th Order Stochastic and Distributionally Robust Dominance Constraints Induced by Full Random Recourse