Abstract:We consider stability issues in minimizing a continuous (probably parameterized, nonconvex and nonsmooth) real-valued function f . We call a point stationary if all its possible directional derivatives are nonnegative. In this work, we focus on two notions of stability on stationary points of f : parametric stability and convergence stability. Parametric considerations are widely studied in various ﬁelds, including smoothed analysis, numerical stability, condition numbers and sensitivity analysis for linear programming. Parametric stability asks whether minor perturbations on parameters lead to dramatic changes in the position and f value of a stationary point. Meanwhile, convergence stability indicates a non-escapable solution: Any point sequence iteratively produced by an optimization algorithm cannot escape from a neighborhood of a stationary point but gets close to it in the sense that such stationary points are stable to the precision parameter and algorithmic numerical errors. It turns out that these notions have deep connections to geometry theory. We show that parametric stability is linked to deformations of graphs of functions. On the other hand, convergence stability is concerned with area partitioning of the function domain. Utilizing these connections, we prove quite tight conditions of these two stability notions for a wide range of functions and optimization algorithms with small enough step sizes and precision parameters. These conditions are subtle in the sense that a slightly weaker function requirement goes to the opposite of primitive intuitions and leads to wrong conclusions. We present three applications of this theory. First, we provide a thorough analysis of parametric stability and convergence stability on the state-of-the-art approximation algorithm computing Nash equilibria in bi-matrix games, Tsaknakis-Spirakis (TS for

A convergence proof and parameter analysis of central force optimization algorithm

Convergence Analysis and Performance of an Extended Central Force Optimization Algorithm

Adaptive Central Force Optimization Algorithm Based on the Stability Analysis

Stabilizing Model Predictive Control Scheme for Piecewise Affine Systems with Maximal Positively Invariant Terminal Set

Modeling of Underconstrained Systems with the Force Method

Convergence Depth Control for Process System Optimization

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach

Design of compliant constant-output-force mechanisms using topology optimization

A Multi-Start Central Force Optimization for Global Optimization

Precision Motion Control of Constrained SISO Nonlinear System Via Direct Optimized Compensation

Convergence depth control for interior point methods

An Improved Central Force Optimization Algorithm for Multimodal Optimization

Central Force Optimization with Self-Adaptive Control Strategy of Population Size

Convergence of the quantum dynamics framework for optimization algorithm

Buckling-induced instability in topology optimization of compliant constant-force mechanisms

An inertial hybrid DFPM-based algorithm for constrained nonlinear equations with applications

Convergence Analysis for the CMFD Accelerated Linear Axial Expansion Transport Method Based on Fourier Analysis

Convergence and quasi-optimality of an adaptive finite element method for optimal control problems with integral control constraint

Superconvergence analysis of a nonconforming finite element method for monotone semilinear elliptic optimal control problems

Convergence of an Algorithm for Optimal Control of Nonlinear Continuous-Time Systems with Model-Reality Differences

On Convergence Lemma and Convergence Stability for Piecewise Analytic Functions