On some recent applications of stochastic convex ordering theorems to some functional inequalities for convex functions - a survey

Teresa Rajba

DOI: https://doi.org/10.48550/arXiv.1701.09036

2017-01-31

Abstract:This is a survey paper concerning some theorems on stochastic convex ordering and their applications to functional inequalities for convex functions. We present the recent results on those subjects

Classical Analysis and ODEs

What problem does this paper attempt to address?

Constraint Qualifications for Convex Inequality Systems with Applications in Constrained Optimization

Chong Li,K. F. Ng,T. K. Pong

DOI: https://doi.org/10.1137/060676982

IF: 2.763

2008-01-01

SIAM Journal on Optimization

Abstract:For an inequality system defined by an infinite family of proper convex functions, we introduce some new notions of constraint qualifications in terms of the epigraphs of the conjugates of these functions and study relationships between these new constraint qualifications and other well-known constraint qualifications including the basic constraint qualification studied by Hiriart-Urrutty and Lemarechal and by Li, Nahak, and Singer. Extensions of known results to more general settings are presented, and applications to particular important problems, such as conic programming and approximation theory, are also studied.
Solving a Class of Convex Stochastic Programs Via Monte Carlo Simulation

Maojun Zhang,Zunquan Xia,Mingzheng Wang,Jiangxia Nan

DOI: https://doi.org/10.3969/j.issn.1007-6093.2009.02.004

2009-01-01

Abstract:Algorithms based on Monte Carlo sampling both of objective and constraint functions are presented for solving convex stochastic programs, and their convergence theorems are given. They are employed to deal with portfolio optimization problems with a semi-variance constraint. Numerical experiments are also given.
Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

An Liu,Vincent K. N. Lau,Borna Kananian

DOI: https://doi.org/10.1109/tsp.2019.2925601

IF: 4.875

2019-01-01

IEEE Transactions on Signal Processing

Abstract:This paper proposes a constrained stochastic successive convex approximation (CSSCA) algorithm to find a stationary point for a general non-convex stochastic optimization problem, whose objective and constraint functions are non-convex and involve expectations over random states. Most existing methods for non-convex stochastic optimization, such as the stochastic (average) gradient and stochastic majorization-minimization, only consider minimizing a stochastic non-convex objective over a deterministic convex set. The proposed CSSCA algorithm can also handle stochastic non-convex constraints in optimization problems, and it opens the way to solving more challenging optimization problems that occur in many applications. The algorithm is based on solving a sequence of convex objective/feasibility optimization problems obtained by replacing the objective/constraint functions in the original problems with some convex surrogate functions. The CSSCA algorithm allows a wide class of surrogate functions and thus provides many freedoms to design good surrogate functions for specific applications. Moreover, it also facilitates parallel implementation for solving large-scale stochastic optimization problems, which arise naturally in today's signal processing such as machine learning and big data analysis. We establish the convergence of the CSSCA algorithm with a feasible initial point, and customize the algorithmic framework to solve several important application problems. Simulations show that the CSSCA algorithm can achieve superior performance over existing solutions.
Some functional inequalities and inclusion relationships associated with certain families of integral operators

Chun-Yi Gao,Shao-Mou Yuan,H. M. Srivastava

DOI: https://doi.org/10.1016/j.camwa.2004.10.041

IF: 3.218

2005-01-01

Computers & Mathematics with Applications

Abstract:By making use of certain familiar integral operators, the authors introduce and investigate several new subclasses of starlike, convex, close-to-convex, and quasi-convex functions. Among other results presented here, the authors establish a number of inclusion relationships associated with some of these integral operators. Some of the results established in this paper would provide extensions of those given in earlier works.
Real Algebraic Geometry and its Applications

Tim Netzer

DOI: https://doi.org/10.48550/arXiv.1606.07284

2016-06-23

Abstract:This is a survey article on real algebra and geometry, and in particular on its recent applications in optimization and convexity. We first introduce basic notions and results from the classical theory. We then explain how these relate to optimization, mostly via semidefinite programming. We introduce interesting geometric problems arising from the classification of feasible sets for semidefinite programming. We close with a perspective on the very active area of non-commutative real algebra and geometry.

Algebraic Geometry,Optimization and Control
On Extended Class of Totally Ordered Interval-Valued Convex Stochastic Processes and Applications

Muhammad Zakria Javed,Muhammad Uzair Awan,Loredana Ciurdariu,Silvestru Sever Dragomir,Yahya Almalki

DOI: https://doi.org/10.3390/fractalfract8100577

IF: 3.577

2024-10-01

Fractal and Fractional

Abstract:The intent of the current study is to explore convex stochastic processes within a broader context. We introduce the concept of unified stochastic processes to analyze both convex and non-convex stochastic processes simultaneously. We employ weighted quasi-mean, non-negative mapping γ, and center-radius ordering relations to establish a class of extended cr-interval-valued convex stochastic processes. This class yields a combination of innovative convex and non-convex stochastic processes. We characterize our class by illustrating its relationships with other classes as well as certain key attributes and sufficient conditions for this class of processes. Additionally, leveraging Riemann–Liouville stochastic fractional operators and our proposed class, we prove parametric fractional variants of Jensen's inequality, Hermite–Hadamard's inequality, Fejer's inequality, and product Hermite–Hadamard's like inequality. We establish an interesting relation between means by means of Hermite–Hadamard's inequality. We utilize the numerical and graphical approaches to showcase the significance and effectiveness of primary findings. Also, the proposed results are powerful tools to evaluate the bounds for stochastic Riemann–Liouville fractional operators in different scenarios for a larger space of processes.

mathematics, interdisciplinary applications
The FM and BCQ Qualifications for Inequality Systems of Convex Functions in Normed Linear Spaces

Chong Li,Kung Fu Ng,Jen-Chih Ya,Xiaopeng Zhao

DOI: https://doi.org/10.1137/20m1324259

IF: 2.763

2021-01-01

SIAM Journal on Optimization

Abstract:For an inequality system defined by an infinite family of proper lower semicontinuous convex functions in normed linear space, we consider the Farkas-Minkowski (FM for short) type qualification and the basic constraint qualification (BCQ for short). By employing a new approach based on some new results established here on the SECQ (sum of epigraphs constraint qualification) for families of closed convex sets, some sufficient conditions involving further relaxing Slater type conditions for ensuring the FM qualification are provided. As applications, new sufficient conditions for ensuring the BCQ are given. These results significantly improve the corresponding ones in [C. Li and K. F. Ng, SIAM T. Optim., 15 (2005), pp. 488-512] and [C. Li, X. P. Zhao, and Y. H. Hu, SIAM J. Optim., 23 (2013), pp. 2208-2230], and they are obtained without the key continuity assumption on the sup-function of the inequality system which the previous works depend heavily on. Some examples are also presented to illustrate the applicability of our results.
Convex duality for stochastic singular control problems

Peter Bank,Helena Kauppila

DOI: https://doi.org/10.48550/arXiv.1407.7717

2014-07-29

Abstract:We develop a general theory of convex duality for certain singular control problems, taking the abstract results by Kramkov and Schachermayer (1999) for optimal expected utility from nonnegative random variables to the level of optimal expected utility from increasing, adapted controls. The main contributions are the formulation of a suitable duality framework, the identification of the problem's dual functional as well as the full duality for the primal and dual value functions and their optimizers. The scope of our results is illustrated by an irreversible investment problem and the Hindy-Huang-Kreps utility maximization problem for incomplete financial markets.

Optimization and Control,Portfolio Management
A Survey on Probabilistically Constrained Optimization Problems

Xiaodi Bai,Xiaojin Zheng,Xiaoling Sun

DOI: https://doi.org/10.3934/naco.2012.2.767

2012-01-01

Numerical Algebra, Control and Optimization

Abstract:Probabilistically constrained optimization problems are an important class of stochastic programming problems with wide applications in finance, management and engineering planning. In this paper, we summarize some important solution methods including convex approximation, DC approach, scenario approach and integer programming approach. We also discuss some future research perspectives on the probabilistically constrained optimization problems.
Applications of Convex Analysis within Mathematics

Francisco J. Aragón Artacho,Jonathan M. Borwein,Victoria Martín-Márquez,Liangjin Yao

DOI: https://doi.org/10.48550/arXiv.1302.1978

2013-07-21

Abstract:In this paper, we study convex analysis and its theoretical applications. We first apply important tools of convex analysis to Optimization and to Analysis. We then show various deep applications of convex analysis and especially infimal convolution in Monotone Operator Theory. Among other things, we recapture the Minty surjectivity theorem in Hilbert space, and present a new proof of the sum theorem in reflexive spaces. More technically, we also discuss autoconjugate representers for maximally monotone operators. Finally, we consider various other applications in mathematical analysis.

Functional Analysis,Optimization and Control
On relations between some types of convex functions

Shoshana Abramovich

2024-08-14

Abstract:In this paper we show how the superquadratic functions can be used as a tool for researching other types of convex functions like $\phi $-convexity, strong-convexity and uniform convexity. We show how to use inequalities satisfied by superquadratic functions and how to adapt the technique used to get them in order to obtain new results satisfied by uniformly convex functions and to $\phi $-convex functions. Also, we show examples that emphasize relations between superquadracity and some other types of convex functions

Functional Analysis
Variational Inequality Approach to Stochastic Nash Equilibrium Problems with an Application to Cournot Oligopoly

B. Jadamba,F. Raciti

DOI: https://doi.org/10.1007/s10957-014-0673-9

2014-11-06

Journal of Optimization Theory and Applications

Abstract:In this note, we investigate stochastic Nash equilibrium problems by means of monotone variational inequalities in probabilistic Lebesgue spaces. We apply our approach to a class of oligopolistic market equilibrium problems, where the data are known through their probability distributions.

mathematics, applied,operations research & management science
Some calculus rules, generalized convexity via convexifactors and their applications

Bhawna Kohli

DOI: https://doi.org/10.1007/s13226-024-00578-4

2024-06-25

Indian Journal of Pure and Applied Mathematics

Abstract:In this paper, convexifactors of product and quotient of functions are computed. Generalized convexity of these functions in terms of convexifactors is studied. The obtained results are then applied to develop optimality conditions for fractional programming problem.

mathematics
Some convexity and monotonicity results of trace functionals

Haonan Zhang

DOI: https://doi.org/10.1007/s00023-023-01345-7

2023-07-09

Abstract:In this paper, we prove the convexity of trace functionals $$(A,B,C)\mapsto \text{Tr}|B^{p}AC^{q}|^{s},$$ for parameters $(p,q,s)$ that are best possible, where $B$ and $C$ are any $n$-by-$n$ positive definite matrices, and $A$ is any $n$-by-$n$ matrix. We also obtain the monotonicity versions of trace functionals of this type. As applications, we extend some results in \cite{HP12quasi,CFL16some} and resolve a conjecture in \cite{RZ14} in the matrix setting. Other conjectures in \cite{RZ14} will also be discussed. We also show that some related trace functionals are not concave in general. Such concavity results were expected to hold in different problems.

Mathematical Physics,Functional Analysis,Quantum Physics
Stochastic subgradient for composite optimization with functional constraints

Ion Necoara,Nitesh Kumar Singh

2024-01-15

Abstract:In this paper we consider convex optimization problems with stochastic composite objective function subject to (possibly) infinite intersection of constraints. The objective function is expressed in terms of expectation operator over a sum of two terms satisfying a stochastic bounded gradient condition, with or without strong convexity type properties. In contrast to the classical approach, where the constraints are usually represented as intersection of simple sets, in this paper we consider that each constraint set is given as the level set of a convex but not necessarily differentiable function. Based on the flexibility offered by our general optimization model we consider a stochastic subgradient method with random feasibility updates. At each iteration, our algorithm takes a stochastic proximal (sub)gradient step aimed at minimizing the objective function and then a subsequent subgradient step minimizing the feasibility violation of the observed random constraint. We analyze the convergence behavior of the proposed algorithm for diminishing stepsizes and for the case when the objective function is convex or strongly convex, unifying the nonsmooth and smooth cases. We prove sublinear convergence rates for this stochastic subgradient algorithm, which are known to be optimal for subgradient methods on this class of problems. When the objective function has a linear least-square form and the constraints are polyhedral, it is shown that the algorithm converges linearly. Numerical evidence supports the effectiveness of our method in real problems.

Optimization and Control
A stochastic regularized second-order iterative scheme for optimal control and inverse problems in stochastic partial differential equations

Marc Dambrine,Akhtar A Khan,Miguel Sama

DOI: https://doi.org/10.1098/rsta.2021.0352

2022-11-14

Abstract:Numerous applied models used in the study of optimal control problems, inverse problems, shape optimization, machine learning, fractional programming, neural networks, image registration and so on lead to stochastic optimization problems in Hilbert spaces. Under a suitable convexity assumption on the objective function, a necessary and sufficient optimality condition for stochastic optimization problems is a stochastic variational inequality. This article presents a new stochastic regularized second-order iterative scheme for solving a variational inequality in a stochastic environment where the primary operator is accessed by employing sampling techniques. The proposed iterative scheme, which fits within the general framework of the stochastic approximation approach, has its almost-sure convergence analysis given in a Hilbert space. We test the feasibility and the efficacy of the proposed stochastic approximation approach for a stochastic optimal control problem and a stochastic inverse problem, both associated with a second-order stochastic partial differential equation. This article is part of the theme issue 'Non-smooth variational problems and applications'.
Dual Solutions in Convex Stochastic Optimization

Teemu Pennanen,Ari-Pekka Perkkiö

DOI: https://doi.org/10.1287/moor.2022.0270

IF: 2.215

2024-09-14

Mathematics of Operations Research

Abstract:This paper studies duality and optimality conditions for general convex stochastic optimization problems. The main result gives sufficient conditions for the absence of a duality gap and the existence of dual solutions in a locally convex space of random variables. It implies, in particular, the necessity of scenario-wise optimality conditions that are behind many fundamental results in operations research, stochastic optimal control, and financial mathematics. Our analysis builds on the theory of Fréchet spaces of random variables whose topological dual can be identified with the direct sum of another space of random variables and a space of singular functionals. The results are illustrated by deriving sufficient and necessary optimality conditions for several more specific problem classes. We obtain significant extensions to earlier models, for example, on stochastic optimal control, portfolio optimization, and mathematical programming.

mathematics, applied,operations research & management science
Stochastic Optimization for Non-convex Inf-Projection Problems

Yan Yan,Yi Xu,Lijun Zhang,Xiaoyu Wang,Tianbao Yang

DOI: https://doi.org/10.48550/arXiv.1908.09941

2020-07-14

Abstract:In this paper, we study a family of non-convex and possibly non-smooth inf-projection minimization problems, where the target objective function is equal to minimization of a joint function over another variable. This problem include difference of convex (DC) functions and a family of bi-convex functions as special cases. We develop stochastic algorithms and establish their first-order convergence for finding a (nearly) stationary solution of the target non-convex function under different conditions of the component functions. To the best of our knowledge, this is the first work that comprehensively studies stochastic optimization of non-convex inf-projection minimization problems with provable convergence guarantee. Our algorithms enable efficient stochastic optimization of a family of non-decomposable DC functions and a family of bi-convex functions. To demonstrate the power of the proposed algorithms we consider an important application in variance-based regularization. Experiments verify the effectiveness of our inf-projection based formulation and the proposed stochastic algorithm in comparison with previous stochastic algorithms based on the min-max formulation for achieving the same effect.

Machine Learning,Optimization and Control
A Class of Quasi-Variational Inequalities with Unbounded Constraint Maps: Existence Results and Applications

Asrifa Sultana,Shivani Valecha

2024-07-26

Abstract:The quasi-variational inequalities play a significant role in analyzing a wide range of real-world problems. However, these problems are more complicated to solve than variational inequalities as the constraint set is based on the current point. We study a class of quasi-variational inequality problems whose specific structure is beneficial in finding some of its solutions by solving a corresponding variational inequality problem. Based on the classical existence theorem for variational inequalities, our main results ensure the occurrence of solutions for the aforementioned class of quasi-variational inequalities in which the associated constraint maps are (possibly) unbounded. We employ a coercivity condition which plays a crucial role in obtaining these results. Finally, we apply our existence results to ensure the occurrence of equilibrium for the pure exchange economic problems and the jointly convex generalized Nash games.

Optimization and Control,Functional Analysis

On some recent applications of stochastic convex ordering theorems to some functional inequalities for convex functions - a survey

Constraint Qualifications for Convex Inequality Systems with Applications in Constrained Optimization

Solving a Class of Convex Stochastic Programs Via Monte Carlo Simulation

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

Some functional inequalities and inclusion relationships associated with certain families of integral operators

Real Algebraic Geometry and its Applications

On Extended Class of Totally Ordered Interval-Valued Convex Stochastic Processes and Applications

The FM and BCQ Qualifications for Inequality Systems of Convex Functions in Normed Linear Spaces

Convex duality for stochastic singular control problems

A Survey on Probabilistically Constrained Optimization Problems

Applications of Convex Analysis within Mathematics

On relations between some types of convex functions

Variational Inequality Approach to Stochastic Nash Equilibrium Problems with an Application to Cournot Oligopoly

Some calculus rules, generalized convexity via convexifactors and their applications

Some convexity and monotonicity results of trace functionals

Stochastic subgradient for composite optimization with functional constraints

A stochastic regularized second-order iterative scheme for optimal control and inverse problems in stochastic partial differential equations

Dual Solutions in Convex Stochastic Optimization

Stochastic Optimization for Non-convex Inf-Projection Problems

A Class of Quasi-Variational Inequalities with Unbounded Constraint Maps: Existence Results and Applications