A simple proof of the Karush-Kuhn-Tucker theorem with finite number of equality and inequality constraints

Ramzi May

DOI: https://doi.org/10.48550/arXiv.2007.12483

2020-07-23

Abstract:We provide a simple and short proof of the Karush-Kuhn-Tucker theorem with finite number of equality and inequality constraints. The proof relies on an elementary linear algebra lemma and the local inverse theorem.

Optimization and Control

What problem does this paper attempt to address?

On the multiplier rules

Joël Blot

DOI: https://doi.org/10.1080/02331934.2015.1113531

IF: 2.2

2015-11-25

Optimization

Abstract:We establish new results of first-order necessary conditions of optimality for finite-dimensional problems with inequality constraints and for problems with equality and inequality constraints, in the form of John’s theorem and in the form of Karush–Kuhn–Tucker’s theorem. In comparison with existing results, we weaken assumptions of continuity and of differentiability.

mathematics, applied,operations research & management science
A simple proof of existence of Lagrange multipliers

Gabriel Haeser,Daiana Oliveira dos Santos

2024-02-09

Abstract:In the seminal book Méchanique analitique, Lagrange, 1788, the notion of a Lagrange multiplier was first introduced in order to study a smooth minimization problem subject to equality constraints. The idea is that, under some regularity assumption, at a solution of the problem, one may associate a new variable (Lagrange multiplier) to each constraint such that an equilibrium equation is satisfied. This concept turned out to be central in studying more general constrained optimization problems and it has lead to the rapid development of nonlinear programming as a field of mathematics since the works of Karush and Kuhn-Tucker, who considered equality and inequality constraints. The usual proofs for the existence of Lagrange multipliers are somewhat cumbersome, relying on the implicit function theorem or duality theory. In the first section of this note we present an elementary proof of existence of Lagrange multipliers in the simplest context, which is easily accessible to a wide variety of readers. In addition, this proof is readily extended to the much more general context of conic constraints, which we present in the second section together with the background properties needed on the projection onto a closed and convex cone.

Optimization and Control
Dual Kuhn-Tucker necessary conditions for strict minima of order two for nonsmooth vector optimization problems with inequality and equality constraints

Elena Constantin

DOI: https://doi.org/10.1080/02331934.2024.2358403

IF: 2.2

2024-05-31

Optimization

Abstract:In this paper, we give primal and dual Kuhn-Tucker necessary conditions for the existence of a strict local minimum of order two for vector optimization problems with equality and inequality constraints under some new regularity conditions. First, we improve the existing primal necessary conditions for such minima. Then, we apply an alternative theorem to derive dual Kuhn-Tucker necessary conditions of second and higher-order. To compare our results to the ones in the literature, we provide some examples.

mathematics, applied,operations research & management science
A short proof and a generalization of the BKR-inequality

Martin Hutzenthaler

DOI: https://doi.org/10.48550/arXiv.0807.4038

2008-07-25

Probability

Abstract:There is a serious mistake in the proof.
A Shorter Proof to Uniqueness of Solutions of Equations.

MS Ying

DOI: https://doi.org/10.1016/s0304-3975(98)00187-x

IF: 1.002

1999-01-01

Theoretical Computer Science

Abstract:We give a very short proof of uniqueness of solutions of equations regarding observation congruence, the main notion of equality, over Milner's process calculus.
A simple proof of necessity in the McCullough-Quiggin theorem

Greg Knese

DOI: https://doi.org/10.1090/proc/15061

2019-12-31

Abstract:A short and simple proof of necessity in the McCullough-Quiggin characterization of positive semi-definite kernels with the complete Pick property is presented.

Functional Analysis,Complex Variables
Constraint Qualifications for Convex Inequality Systems with Applications in Constrained Optimization

Chong Li,K. F. Ng,T. K. Pong

DOI: https://doi.org/10.1137/060676982

IF: 2.763

2008-01-01

SIAM Journal on Optimization

Abstract:For an inequality system defined by an infinite family of proper convex functions, we introduce some new notions of constraint qualifications in terms of the epigraphs of the conjugates of these functions and study relationships between these new constraint qualifications and other well-known constraint qualifications including the basic constraint qualification studied by Hiriart-Urrutty and Lemarechal and by Li, Nahak, and Singer. Extensions of known results to more general settings are presented, and applications to particular important problems, such as conic programming and approximation theory, are also studied.
On the weakest constraint qualification for sharp local minimizers

Oliver Stein,Maximilian Volk

DOI: https://doi.org/10.1080/02331934.2024.2322155

IF: 2.2

2024-03-02

Optimization

Abstract:The sharp local minimality of feasible points of nonlinear optimization problems is known to possess a characterization by a strengthened version of the Karush–Kuhn–Tucker conditions, as long as the Mangasarian–Fromovitz constraint qualification holds. This strengthened condition is not easy to check algorithmically since it involves the topological interior of some set. In this article, we derive an algorithmically tractable version of this condition, called strong Karush–Kuhn–Tucker condition. We show that the Guignard constraint qualification is the weakest condition under which a feasible point is a strong Karush–Kuhn–Tucker point for every continuously differentiable objective function possessing the point as a sharp local minimizer. As an application, our results yield an algebraic characterization of strict local minimizers of linear programs with cardinality constraints.

mathematics, applied,operations research & management science
A short proof of the Arendt-Chernoff-Kato theorem

Sergiy Koshkin

DOI: https://doi.org/10.1007/s00013-013-0543-y

2013-08-15

Abstract:We give a short new proof of the Arendt-Chernoff-Kato theorem, which characterizes generators of positive C0 semigroups in order unit spaces. The proof avoids half-norms and subdifferentials, and is based on a sufficient condition for an operator to have positive inverse, which is new even for matrices.

Functional Analysis
The Proof of Kazhdan-Mazur's Nonvanishing Hypothesis

Binyong Sun

DOI: https://doi.org/10.3969/j.issn.1673-8128.2018.01.024

2018-01-01

Abstract:We prove the nonvanishing hypothesis at infinity for Rankin-Selberg convolutions for GL(n)× GL(n-1).
Approximate Solutions for Abstract Inequality Systems

Chong Li,K. F. Ng

DOI: https://doi.org/10.1137/120885176

IF: 2.763

2013-01-01

SIAM Journal on Optimization

Abstract:We consider conic inequality systems of the type$F(x)\ge_K 0$, with approximate solution $x_0$ associated to a parameter $\tau$,where $F$ is a twice Fréchet differentiable function between Hilbert spaces $X$ and $Y$, and$\ge_K$ is the partial order in $Y$ defined by anonempty convex (not necessarily closed) cone $K\subseteq Y$.We prove that, under the suitable conditions,the system $F(x)\ge_K 0$is solvable, and the ratio of the distance from $x_0$ to the solution set $S$ over the distance from $F(x_0)$ to the cone $K$ has anupper bound given explicitlyin terms of $\tau$ and $x_0$. We show that the upper bound is sharp.Applications to analytic function inequality/equality systems on Euclidean spaces are given,and the corresponding results of Dedieu [ SIAM J. Optim. , 11 (2000), pp. 411--425] are extended and significantly improved.
The Non-Substitution Theorem, Uniqueness of Solution and Convex combinations of basic optimal solutions for linear optimization

Somdeb Lahiri

2024-10-14

Abstract:Our first result is a statement of a somewhat general form of a non-substitution theorem for linear programming problems, along with a very easy proof of the same. Subsequently, we provide an easy proof of theorem 1 in a 1979 paper by Olvi L Mangasarian based on a lemma that may be of some significance by itself. We also provide a simple proof of the result that states that the set of optimal solutions of a bounded linear optimization problem is the set of all convex combinations of its basic optimal solutions and the set of basic optimal solutions are the extreme points of the set of optimal solutions. We do so by appealing to the well-known lemma of Farkas and another well-known result that states that if a linear optimization problem has an optimal solution, it has at least one basic optimal solution. Both results we appeal to have easy proofs. We do not appeal to any version of the Klein-Milman Theorem or any result in advanced polyhedral combinatorics to obtain our results.

Optimization and Control
A Simple Proof of the Riemann's Hypothesis

Charaf Ech-Chatbi

DOI: https://doi.org/10.13140/RG.2.2.32078.10564

2023-11-04

Abstract:We present a simple proof of the Riemann's Hypothesis (RH) where only undergraduate mathematics is needed.

General Mathematics
Note on a simple trigonometric equality

J.-P. Allouche

DOI: https://doi.org/10.1007/s11139-024-00840-7

2024-03-25

The Ramanujan Journal

Abstract:In a recent paper Vinay, Shweta, and Harshitha use Ramanujan's theta functions to prove several trigonometric equalities. Elementary proofs for some of these equalities were given by the author and Zeilberger, then for all but one by Berndt, Kim, and Zaharescu. The remaining equality was proved in the same paper of Berndt, Kim, and Zaharescu in a non-totally elementary way, in that it uses a result of Gauss in cyclotomy: here we give an elementary proof of the same equality. Also we show how to use automated tools to discover and prove some generalizations.

mathematics
Duality theory in linear optimization and its extensions -- formally verified

Martin Dvorak,Vladimir Kolmogorov

2024-09-12

Abstract:Farkas established that a system of linear inequalities has a solution if and only if we cannot obtain a contradiction by taking a linear combination of the inequalities. We state and formally prove several Farkas-like theorems over linearly ordered fields in Lean 4. Furthermore, we extend duality theory to the case when some coefficients are allowed to take ``infinite values''.

Optimization and Control,Logic in Computer Science
Stability of Minima in Constrained Optimization Problems and Implicit Function Theorem

Aram V. Arutyunov,Kirill A. Tsarkov,Sergey E. Zhukovskiy

DOI: https://doi.org/10.1007/s10957-024-02459-6

2024-05-31

Journal of Optimization Theory and Applications

Abstract:In the paper, we consider both finite-dimensional and infinite-dimensional optimization problems with inclusion-type and equality-type constraints. We obtain sufficient conditions for the stability in the weak topology of a solution to this problem with respect to small perturbations of the problem parameters. In the finite-dimensional case, conditions for the stability in the strong topology of the solution are obtained for the problem with equality-type constraints. These conditions are based on a certain implicit function theorem.

mathematics, applied,operations research & management science
An Information-Theoretic Proof of a Hypercontractive Inequality

Ehud Friedgut

DOI: https://doi.org/10.3390/e26110966

IF: 2.738

2024-11-13

Entropy

Abstract:The famous hypercontractive estimate discovered independently by Gross, Bonami and Beckner has had a great impact on combinatorics and theoretical computer science since it was first used in this setting in a seminal paper by Kahn, Kalai and Linial. The usual proofs of this inequality begin with two-point space, where some elementary calculus is used and then generalised immediately by introducing another dimension using submultiplicativity (Minkowski's integral inequality). In this paper, we prove this inequality using information theory. We compare the entropy of a pair of correlated vectors in {0,1}n to their separate entropies, analysing them bit by bit (not as a figure of speech, but as the bits are revealed) using the chain rule of entropy.

physics, multidisciplinary
On a transversal theorem of Montejano and Karasev

Andreas F. Holmsen

DOI: https://doi.org/10.1007/s00454-023-00573-2

2024-09-05

Abstract:We give a new proof of a theorem of Montejano and Karasev regarding $k$-dimensional transversals to small families of convex sets. While their proof uses technical algebraic and topological tools, our proof is a simple application of the Borsuk-Ulam theorem. Additionally, in certain cases our result is stronger than the Montejano-Karasev theorem.

Combinatorics
On the equality conditions of the Brunn-Minkowski theorem

Daniel A. Klain

DOI: https://doi.org/10.48550/arXiv.1005.1409

2010-05-10

Abstract:This article describes a new proof of the equality condition for the Brunn-Minkowski inequality.

Metric Geometry,Classical Analysis and ODEs,Functional Analysis
Probability Proof of Algebraic Inequalities

LIU Jie,HU Taizhong,ZHUANG Weiwei

DOI: https://doi.org/10.3969/j.issn.1008-1399.2023.01.008

2023-01-01

Abstract:This paper studies the use of three probability properties in the proof of algebraic inequalities, including strong additivity of probability, nonnegativity of variance and linear property of expectation. We expound on how to construct random events and random variables according to the characteristics of the inequalities. Several examples with the detailed proofs are provided to show our approaches.

A simple proof of the Karush-Kuhn-Tucker theorem with finite number of equality and inequality constraints

On the multiplier rules

A simple proof of existence of Lagrange multipliers

Dual Kuhn-Tucker necessary conditions for strict minima of order two for nonsmooth vector optimization problems with inequality and equality constraints

A short proof and a generalization of the BKR-inequality

A Shorter Proof to Uniqueness of Solutions of Equations.

A simple proof of necessity in the McCullough-Quiggin theorem

Constraint Qualifications for Convex Inequality Systems with Applications in Constrained Optimization

On the weakest constraint qualification for sharp local minimizers

A short proof of the Arendt-Chernoff-Kato theorem

The Proof of Kazhdan-Mazur's Nonvanishing Hypothesis

Approximate Solutions for Abstract Inequality Systems

The Non-Substitution Theorem, Uniqueness of Solution and Convex combinations of basic optimal solutions for linear optimization

A Simple Proof of the Riemann's Hypothesis

Note on a simple trigonometric equality

Duality theory in linear optimization and its extensions -- formally verified

Stability of Minima in Constrained Optimization Problems and Implicit Function Theorem

An Information-Theoretic Proof of a Hypercontractive Inequality

On a transversal theorem of Montejano and Karasev

On the equality conditions of the Brunn-Minkowski theorem

Probability Proof of Algebraic Inequalities