Generic continuity of the perturbed minima of certain parametric optimization problems

Hristina Topalova,Nadia Zlateva

2024-10-19

Abstract:We show that in a quite general framework, the parameterized optimization problem can be so perturbed as to be generically well-posed. As an application, we provide a contribution to Stechkin theory.

Optimization and Control,Functional Analysis

What problem does this paper attempt to address?

GENERIC WELL-POSEDNESS FOR PERTURBED OPTIMIZATION PROBLEMS IN BANACH SPACES

Li Peng,Chong Li,Jen Chih Yao

DOI: https://doi.org/10.11650/tjm.14.2010.307

2010-01-01

Taiwanese Journal of Mathematics

Abstract:Let $X$ be a Banach space and $Z$ a relatively weakly compact subset of $X$. Let $J: Z\rightarrow\mathbb{R}$ be a upper semicontinuous function bounded from above and $p\geq1$. This paper is concerned with the perturbed optimization problem of finding $z_0\in Z$ such that $\|x-z_0\|^p+J(z_0)=\sup_{z\in Z}\{\|x-z\|^p+J(z)\}$, which is denoted by $\max_J(x,Z)$. We prove in the present paper that if $X$ is Kadec w.r.t. $Z$, then the set of all $x\in X$ such that the problem $\max_J(x,Z)$ is generalized well-posed is a dense $G_\delta$-subset of $X$. If $X$ is additionally $J$-strictly convex w.r.t. $Z$ and $p>1$, we prove that the set of all $x\in X$ such that the problem $\max_J(x,Z)$ is well-posed is a dense $G_\delta$-subset of $X$.
Continuity of the solutions sets for parametric set optimization problems

Manli Yang,Taiyong Li,Guanghui Xu

DOI: https://doi.org/10.1186/s13660-024-03138-w

2024-05-01

Journal of Inequalities and Applications

Abstract:The current study focuses on exploring the stability of solution sets pertaining to set optimization problems, particularly with regard to the set order relation outlined by Karaman et al. 2018. Sufficient conditions are provided for the lower semicontinuity, upper semicontinuity, and compactness of m -minimal solution mappings in parametric set optimization, where the involved set-valued mapping is Lipschitz continuous.

mathematics, applied
Continuity of Parametric Optima for Possibly Discontinuous Functions and Noncompact Decision Sets

Eugene A. Feinberg,Pavlo O. Kasyanov,David N. Kraemer

DOI: https://doi.org/10.48550/arXiv.2109.06299

2021-09-14

Abstract:This paper investigates continuity properties of value functions and solutions for parametric optimization problems. These problems are important in operations research, control, and economics because optimality equations are their particular cases. The classic fact, Berge's maximum theorem, gives sufficient conditions for continuity of value functions and upper semicontinuity of solution multifunctions. Berge's maximum theorem assumes that the objective function is continuous and the multifunction of feasible sets is compact-valued. These assumptions are not satisfied in many applied problems, which historically has limited the relevance of the theorem. This paper generalizes Berge's maximum theorem in three directions: (i) the objective function may not be continuous, (ii) the multifunction of feasible sets may not be compact-valued, and (iii) necessary and sufficient conditions are provided. To illustrate the main theorem, this paper provides applications to inventory control and to the analysis of robust optimization over possibly noncompact action sets and discontinuous objective functions.

Optimization and Control
Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach

Xiaotie Deng,Hanyu Li,Ningyuan Li

DOI: https://doi.org/10.48550/arXiv.2204.01643

2022-01-01

Abstract:We consider stability issues in minimizing a continuous (probably parameterized, nonconvex and nonsmooth) real-valued function f . We call a point stationary if all its possible directional derivatives are nonnegative. In this work, we focus on two notions of stability on stationary points of f : parametric stability and convergence stability. Parametric considerations are widely studied in various ﬁelds, including smoothed analysis, numerical stability, condition numbers and sensitivity analysis for linear programming. Parametric stability asks whether minor perturbations on parameters lead to dramatic changes in the position and f value of a stationary point. Meanwhile, convergence stability indicates a non-escapable solution: Any point sequence iteratively produced by an optimization algorithm cannot escape from a neighborhood of a stationary point but gets close to it in the sense that such stationary points are stable to the precision parameter and algorithmic numerical errors. It turns out that these notions have deep connections to geometry theory. We show that parametric stability is linked to deformations of graphs of functions. On the other hand, convergence stability is concerned with area partitioning of the function domain. Utilizing these connections, we prove quite tight conditions of these two stability notions for a wide range of functions and optimization algorithms with small enough step sizes and precision parameters. These conditions are subtle in the sense that a slightly weaker function requirement goes to the opposite of primitive intuitions and leads to wrong conclusions. We present three applications of this theory. First, we provide a thorough analysis of parametric stability and convergence stability on the state-of-the-art approximation algorithm computing Nash equilibria in bi-matrix games, Tsaknakis-Spirakis (TS for
Generalized well-posedness with perturbation of set optimization problems in terms of lower set less order relation

Jia Liu,Qamrul Hasan Ansari,Jiawei Chen,Wenyan Zhang

2020-01-01

Journal of nonlinear and convex analysis

Abstract:The aim of this paper is to investigate the generalized well-posedness with perturbation of set optimization problems (SOP) in terms of lower set less order relation. Based on the lower set less order relation, we introduce the notion of generalized well-posedness with perturbation of (SOP). Then the relationships between the generalized well-posedness with perturbation and the well-setness with perturbation of (SOP) are established under some suitable assumptions. We also present the sufficient conditions for the generalized well-posedness with perturbation and well-setness with perturbation. Moreover, we obtain the relationships between semicontinuity of minimal solution mappings of a parametric set optimization problem and the generalized well-posedness with perturbation of (SOP). Finally, the equivalence between the generalized well-posedness with perturbation of (SOP) and the generalized well-posedness with perturbation of a corresponding scalar optimization problem is derived by using the scalarization method.
Porosity of perturbed optimization problems in Banach spaces

Chong Li,Li Hui Peng

DOI: https://doi.org/10.1016/j.jmaa.2005.12.030

IF: 1.417

2006-01-01

Journal of Mathematical Analysis and Applications

Abstract:Let X be a Banach space and Z a nonempty closed subset of X. Let J:Z→R be a lower semicontinuous function bounded from below. This paper is concerned with the perturbed optimization problem infz∈Z{J(z)+‖x−z‖}, denoted by (x,J)-inf for x∈X. In the case when X is compactly fully 2-convex, it is proved in the present paper that the set of all points x in X for which there does not exist z0∈Z such that J(z0)+‖x−z0‖=infz∈Z{J(z)+‖x−z‖} is a σ-porous set in X. Furthermore, if X is assumed additionally to be compactly locally uniformly convex, we verify that the set of all points x∈X∖Z0 such that the problem (x,J)-inf fails to be approximately compact, is a σ-porous set in X∖Z0, where Z0 denotes the set of all z∈Z such that z∈PZ(z). Moreover, a counterexample to which some results of Ni [R.X. Ni, Generic solutions for some perturbed optimization problem in nonreflexive Banach space, J. Math. Anal. Appl. 302 (2005) 417–424] fail is provided.
Stability of Minima in Constrained Optimization Problems and Implicit Function Theorem

Aram V. Arutyunov,Kirill A. Tsarkov,Sergey E. Zhukovskiy

DOI: https://doi.org/10.1007/s10957-024-02459-6

2024-05-31

Journal of Optimization Theory and Applications

Abstract:In the paper, we consider both finite-dimensional and infinite-dimensional optimization problems with inclusion-type and equality-type constraints. We obtain sufficient conditions for the stability in the weak topology of a solution to this problem with respect to small perturbations of the problem parameters. In the finite-dimensional case, conditions for the stability in the strong topology of the solution are obtained for the problem with equality-type constraints. These conditions are based on a certain implicit function theorem.

mathematics, applied,operations research & management science
Tailored Parameter Optimization Methods for Ordinary Differential Equation Models with Steady-State Constraints

Anna Fiedler,Sebastian Raeth,Fabian J. Theis,Angelika Hausser,Jan Hasenauer

DOI: https://doi.org/10.1186/s12918-016-0319-7

2016-01-01

BMC Systems Biology

Abstract:Background Ordinary differential equation (ODE) models are widely used to describe (bio-)chemical and biological processes. To enhance the predictive power of these models, their unknown parameters are estimated from experimental data. These experimental data are mostly collected in perturbation experiments, in which the processes are pushed out of steady state by applying a stimulus. The information that the initial condition is a steady state of the unperturbed process provides valuable information, as it restricts the dynamics of the process and thereby the parameters. However, implementing steady-state constraints in the optimization often results in convergence problems. Results In this manuscript, we propose two new methods for solving optimization problems with steady-state constraints. The first method exploits ideas from optimization algorithms on manifolds and introduces a retraction operator, essentially reducing the dimension of the optimization problem. The second method is based on the continuous analogue of the optimization problem. This continuous analogue is an ODE whose equilibrium points are the optima of the constrained optimization problem. This equivalence enables the use of adaptive numerical methods for solving optimization problems with steady-state constraints. Both methods are tailored to the problem structure and exploit the local geometry of the steady-state manifold and its stability properties. A parameterization of the steady-state manifold is not required. The efficiency and reliability of the proposed methods is evaluated using one toy example and two applications. The first application example uses published data while the second uses a novel dataset for Raf/MEK/ERK signaling. The proposed methods demonstrated better convergence properties than state-of-the-art methods employed in systems and computational biology. Furthermore, the average computation time per converged start is significantly lower. In addition to the theoretical results, the analysis of the dataset for Raf/MEK/ERK signaling provides novel biological insights regarding the existence of feedback regulation. Conclusion Many optimization problems considered in systems and computational biology are subject to steady-state constraints. While most optimization methods have convergence problems if these steady-state constraints are highly nonlinear, the methods presented recover the convergence properties of optimizers which can exploit an analytical expression for the parameter-dependent steady state. This renders them an excellent alternative to methods which are currently employed in systems and computational biology.
Optimization of a perturbed sweeping process by constrained discontinuous controls

Giovanni Colombo,Boris S. Mordukhovich,Dao Nguyen

DOI: https://doi.org/10.48550/arXiv.1808.04041

2018-08-13

Abstract:This paper deals with optimal control problems described by a controlled version of Moreau's sweeping process governed by convex polyhedra, where measurable control actions enter additive perturbations. This class of problems, which addresses unbounded discontinuous differential inclusions with intrinsic state constraints, is truly challenging and underinvestigated in control theory while being highly important for various applications. To attack such problems with constrained measurable controls, we develop a refined method of discrete approximations with establishing its well-posedness and strong convergence. This approach, married to advanced tools of first-order and second-order variational analysis and generalized differentiations, allows us to derive adequate collections of necessary optimality conditions for local minimizers, first in discrete-time problems and then in the original continuous-time controlled sweeping process by passing to the limit. The new results include an appropriate maximum condition and significantly extend the previous ones obtained under essentially more restrictive assumptions. We compare them with other versions of the maximum principle for controlled sweeping processes that have been recently established for global minimizers in problems with smooth sweeping sets by using different techniques. The obtained necessary optimality conditions are illustrated by several examples.

Optimization and Control
Perturbation analysis of a class of composite optimization problems

Peipei Tang,Chengjing Wang

2024-01-19

Abstract:In this paper, we study the perturbation analysis of a class of composite optimization problems, which is a very convenient and unified framework for developing both theoretical and algorithmic issues of constrained optimization problems. The underlying theme of this paper is very important in both theoretical and computational study of optimization problems. Under some mild assumptions on the objective function, we provide a definition of a strong second order sufficient condition (SSOSC) for the composite optimization problem and also prove that the following conditions are equivalent to each other: the SSOSC and the nondegeneracy condition, the nonsingularity of Clarke's generalized Jacobian of the nonsmooth system at a Karush-Kuhn-Tucker (KKT) point, and the strong regularity of the KKT point. These results provide an important way to characterize the stability of the KKT point.

Optimization and Control,Numerical Analysis
A concentration-compactness principle for perturbed isoperimetric problems with general assumptions

Jules Candau-Tilh

2024-06-24

Abstract:Derived from the concentration-compactness principle, the concept of generalized minimizer can be used to define generalized solutions of variational problems which may have components ``infinitely'' distant from each other. In this article and under mild assumptions we establish existence and density estimates of generalized minimizers of perturbed isoperimetric problems. Our hypotheses encapsulate a wide class of functionals including the classical, anisotropic and fractional perimeter. The perturbation term may for instance take the form of a potential, a translation invariant kernel or a nonlocal term involving the Wasserstein distance.

Analysis of PDEs
The perturbation method applied to a robust optimization problem with constraint

Peng Luo,Alexander Schied,Xiaole Xue

2024-02-13

Abstract:The present paper studies a kind of robust optimization problems with constraint. The problem is formulated through Backward Stochastic Differential Equations (BSDEs) with quadratic generators. A necessary condition is established for the optimal solution using a terminal perturbation method and properties of Bounded Mean Oscillation (BMO) martingales. The necessary condition is further proved to be sufficient for the existence of an optimal solution under an additional convexity assumption. Finally, the optimality condition is applied to discuss problems of partial hedging with ambiguity, fundraising under ambiguity and randomized testing problems for a quadratic $g$-expectation.

Optimization and Control,Probability
On some global implicit function theorems for set-valued inclusions with applications to parametric vector optimization

Amos Uderzo

2024-05-02

Abstract:The present paper deals with the perturbation analysis of set-valued inclusion problems, a problem format whose relevance has recently emerged in such contexts as robust and vector optimization as well as in vector equilibrium theory. The set-valued inclusions here considered are parameterized by variables belonging to a topological space, with and without constraints. By proper techniques of variational analysis, some qualitative global implicit function theorems are established, which ensure global solvability of these problems and continuous dependence on the parameter of the related solutions. Applications to parametric vector optimization are discussed, aimed at deriving sufficient conditions for the existence of ideal efficient solutions that depend continuously on the parameter perturbations.

Optimization and Control
On Computing the Nonlinearity Interval in Parametric Semidefinite Optimization

Jonathan D. Hauenstein,Ali Mohammad-Nezhad,Tingting Tang,Tamás Terlaky

DOI: https://doi.org/10.1287/moor.2021.1234

IF: 2.215

2022-05-13

Mathematics of Operations Research

Abstract:This paper revisits the parametric analysis of semidefinite optimization problems with respect to the perturbation of the objective function along a fixed direction. We review the notions of invariancy set, nonlinearity interval, and transition point of the optimal partition, and we investigate their characterizations. We show that the set of transition points is finite and the continuity of the optimal set mapping, on the basis of Painlevé–Kuratowski set convergence, might fail on a nonlinearity interval. Under a local nonsingularity condition, we then develop a methodology, stemming from numerical algebraic geometry, to efficiently compute nonlinearity intervals and transition points of the optimal partition. Finally, we support the theoretical results by applying our procedure to some numerical examples.

mathematics, applied,operations research & management science
Isolated calmness of perturbation mappings in generalized nonlinear programming and local superlinear convergence of Newton-type methods

Matúš Benko,Patrick Mehlitz

2024-07-02

Abstract:In this paper, we characterize Lipschitzian properties of different multiplier-free and multiplier-dependent perturbation mappings associated with the stationarity system of a so-called generalized nonlinear program popularized by Rockafellar. Special emphasis is put on the investigation of the isolated calmness property at and around a point. The latter is decisive for the locally fast convergence of the so-called semismooth* Newton-type method by Gfrerer and Outrata. Our central result is the characterization of the isolated calmness at a point of a multiplier-free perturbation mapping via a combination of an explicit condition and a rather mild assumption, automatically satisfied e.g. for standard nonlinear programs. Isolated calmness around a point is characterized analogously by a combination of two stronger conditions. These findings are then related to so-called criticality of Lagrange multipliers, as introduced by Izmailov and extended to generalized nonlinear programming by Mordukhovich and Sarabi. We derive a new sufficient condition (a characterization for some problem classes) of nonexistence of critical multipliers, which has been also used in the literature as an assumption to guarantee local fast convergence of Newton-, SQP-, or multiplier-penalty-type methods. The obtained insights about critical multipliers seem to complement the vast literature on the topic.

Optimization and Control
Stability and Continuity in Robust Linear and Linear Semi-Infinite Optimization

Timothy C.Y. Chan,Philip Allen Mar

DOI: https://doi.org/10.48550/arXiv.1509.06640

2015-09-22

Abstract:We consider the stability of Robust Optimization problems with respect to perturbations in their uncertainty sets. We focus on Linear Optimization problems, including those with a possibly infinite number of constraints, also known as Linear Semi-Infinite Optimization (LSIO) problems, and consider uncertainty in both the cost function and constraints. We prove Lipschitz continuity of the optimal value and {\epsilon}-approximate optimal solution set with respect to the Hausdorff distance between uncertainty sets and with an explicit Lipschitz constant that can be calculated. In addition, we prove closedness and upper semi-continuity for the optimal solution set mapping with respect to the uncertainty set.

Optimization and Control
A new perspective on parameter study of optimization problems

Alen Alexanderian,Joseph Hart,Mason Stevens

DOI: https://doi.org/10.48550/arXiv.2209.11580

2022-09-23

Abstract:We provide a new perspective on the study of parameterized optimization problems. Our approach combines methods for post-optimal sensitivity analysis and ordinary differential equations to quantify the uncertainty in the minimizer due to uncertain parameters in the optimization problem. We illustrate the proposed approach with a simple analytic example and an inverse problem governed by an advection diffusion equation.

Optimization and Control,Numerical Analysis
Conservative parametric optimality and the ridge method for tame min-max problems

Edouard Pauwels

DOI: https://doi.org/10.1007/s11228-023-00682-3

2023-06-26

Abstract:We study the ridge method for min-max problems, and investigate its convergence without any convexity, differentiability or qualification assumption. The central issue is to determine whether the ''parametric optimality formula'' provides a conservative field, a notion of generalized derivative well suited for optimization. The answer to this question is positive in a semi-algebraic, and more generally definable, context. The proof involves a new characterization of definable conservative fields which is of independent interest. As a consequence, the ridge method applied to definable objectives is proved to have a minimizing behavior and to converge to a set of equilibria which satisfy an optimality condition. Definability is key to our proof: we show that for a more general class of nonsmooth functions, conservativity of the parametric optimality formula may fail, resulting in an absurd behavior of the ridge method.

Optimization and Control
Optimal control of nonlocal continuity equations: numerical solution

Roman Chertovskih,Nikolay Pogodaev,Maxim Staritsyn

DOI: https://doi.org/10.1007/s00245-023-10062-w

2023-08-01

Abstract:The paper addresses an optimal ensemble control problem for nonlocal continuity equations on the space of probability measures. We admit the general nonlinear cost functional, and an option to directly control the nonlocal terms of the driving vector field. For this problem, we design a descent method based on Pontryagin's maximum principle (PMP). To this end, we derive a new form of PMP with a decoupled Hamiltonian system. Specifically, we extract the adjoint system of linear nonlocal balance laws on the space of signed measures and prove its well-posedness. As an implementation of the designed descent method, we propose an indirect deterministic numeric algorithm with backtracking. We prove the convergence of the algorithm and illustrate its modus operandi by treating a simple case involving a Kuramoto-type model of a population of interacting oscillators.

Optimization and Control,Numerical Analysis

Generic continuity of the perturbed minima of certain parametric optimization problems

GENERIC WELL-POSEDNESS FOR PERTURBED OPTIMIZATION PROBLEMS IN BANACH SPACES

Continuity of the solutions sets for parametric set optimization problems

Continuity of Parametric Optima for Possibly Discontinuous Functions and Noncompact Decision Sets

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach

Generalized well-posedness with perturbation of set optimization problems in terms of lower set less order relation

Porosity of perturbed optimization problems in Banach spaces

Stability of Minima in Constrained Optimization Problems and Implicit Function Theorem

Tailored Parameter Optimization Methods for Ordinary Differential Equation Models with Steady-State Constraints

Optimization of a perturbed sweeping process by constrained discontinuous controls

Perturbation analysis of a class of composite optimization problems

A concentration-compactness principle for perturbed isoperimetric problems with general assumptions

The perturbation method applied to a robust optimization problem with constraint

On some global implicit function theorems for set-valued inclusions with applications to parametric vector optimization

On Computing the Nonlinearity Interval in Parametric Semidefinite Optimization

Isolated calmness of perturbation mappings in generalized nonlinear programming and local superlinear convergence of Newton-type methods

Stability and Continuity in Robust Linear and Linear Semi-Infinite Optimization

A new perspective on parameter study of optimization problems

Conservative parametric optimality and the ridge method for tame min-max problems

Optimal control of nonlocal continuity equations: numerical solution