Von Neumann's minimax theorem through Fourier-Motzkin elimination

Mark Voorneveld

2024-08-21

Abstract:Fourier-Motzkin elimination, a standard method for solving systems of linear inequalities, leads to an elementary, short, and self-contained proof of von Neumann's minimax theorem.

Computer Science and Game Theory,Theoretical Economics

What problem does this paper attempt to address?

A Simpler Approach to Linear Programming

Jean-Louis Lassez

DOI: https://doi.org/10.48550/arXiv.1907.07811

IF: 0.961

2019-07-17

Discrete Mathematics

Abstract:Dantzig and Eaves claimed that fundamental duality theorems of linear programming were a trivial consequence of Fourier elimination. Another property of Fourier elimination is considered here, regarding the existence of implicit equalities rather than solvability. This leads to a different interpretation of duality theory which allows us to use Gaussian elimination to decide solvability of systems of linear inequalities, for bounded systems.
A one-line proof of a minimax theorem (for a notion of curvature on finite graphs)

Yi C. Huang

2024-05-19

Abstract:A one-line proof of a minimax theorem due to Steinerberger is given.

Combinatorics
Notes on Equivalence and Minimization of Weighted Automata

Stefan Kiefer

DOI: https://doi.org/10.48550/arXiv.2009.01217

2020-09-03

Abstract:This set of notes re-proves known results on weighted automata (over a field, also known as multiplicity automata). The text offers a unified view on theorems and proofs that have appeared in the literature over decades and were written in different styles and contexts. None of the results reported here are claimed to be new. The content centres around fundamentals of equivalence and minimization, with an emphasis on algorithmic aspects. The presentation is minimalistic. No attempt has been made to motivate the material. Weighted automata are viewed from a linear-algebra angle. As a consequence, the proofs, which are meant to be succinct, but complete and almost self-contained, rely mainly on elementary linear algebra.

Formal Languages and Automata Theory
Minimax and maximin problems for sums of translates on the real axis

Tatiana Nikiforova

2024-05-14

Abstract:Sums of translates generalize logarithms of weighted algebraic polynomials. The paper presents the solution to the minimax and maximin problems on the real axis for sums of translates. We prove that there is a unique function that is extremal in both problems. The key in our proof is a reduction to the problem on a segment. For this, we work out an analogue of the Mhaskar-Rakhmanov-Saff theorem, too.

Classical Analysis and ODEs
THE ANALYTIC SOLUTIONS OF A CLASS OF CONSTRAINED MATRIX MINIMIZATION AND MAXIMIZATION PROBLEMS WITH APPLICATIONS

Weiwei Xu,Wen Li,Lei Zhu,Xueping Huang

DOI: https://doi.org/10.1137/17m1140777

IF: 2.763

2019-01-01

SIAM Journal on Optimization

Abstract:In this paper we present the analytic solutions of the following constrained matrix determinant and trace minimization and maximization problems: min(U1,) (...,Um is an element of Un) vertical bar det(cI(n) +/- Pi(m)(j=1) A(j)U(j))vertical bar, max(U1,) (...,Um is an element of Un) vertical bar det(cI(n) +/- Pi(m)(j=1) A(j)U(j))vertical bar and min(U1,) (...,Um is an element of Un) vertical bar tr(cI(n) +/- Pi(m)(j=1) A(j)U(j))vertical bar, max(U1,) (...,Um is an element of Un) vertical bar tr(cI(n) +/- Pi(m)(j=1) A(j)U(j))vertical bar, where c is an element of R, A(1),..., A(m) are n x n complex matrices, I-n is the n x n identity matrix, U-n is the set of n x n unitary matrices, and det(center dot) and tr(center dot) denote the matrix determinant function and the trace function, respectively. The given results improve on the corresponding ones in Marshall, Olkin, and Arnold [Inequalities: Theory of Majorization and Its Applications, Springer, New York, 2009], Lu [Acta Math. Sinica, 13 (1963), pp. 49-62], and Sun [SIAM J. Matrix Anal. Appl., 20 (1983), pp. 611-625]. Some theoretical and practical applications are presented. In particular, some examples of applications to test signals of mechanical systems and aero engine fault diagnosis are given to show the efficiency of the proposed theoretical results.
Nash Equilibrium and Minimax Theorems via Variational Tools of Convex Analysis

Nguyen Xuan Duy Bao,Boris Mordukhovich,Nguyen Mau Nam

2024-08-27

Abstract:In this paper, we first provide a simple variational proof of the existence of Nash equilibrium in Hilbert spaces by using optimality conditions in convex minimization and Schauder's fixed-point theorem. Then applications of convex analysis and generalized differentiation are given to the existence of Nash equilibrium and extended versions of von Neumann's minimax theorem in locally convex topological vector spaces. Our analysis in this part combines generalized differential tools of convex analysis with elements of fixed point theory revolving around Kakutani's fixed-point theorem and related issues.

Optimization and Control
Zero-Sum Games and Linear Programming Duality

Bernhard von Stengel

DOI: https://doi.org/10.1287/moor.2022.0149

2023-10-22

Abstract:The minimax theorem for zero-sum games is easily proved from the strong duality theorem of linear programming. For the converse direction, the standard proof by Dantzig (1951) is known to be incomplete. We explain and combine classical theorems about solving linear equations with nonnegative variables to give a correct alternative proof, more directly than Adler (2013). We also extend Dantzig's game so that any max-min strategy gives either an optimal LP solution or shows that none exists.

Computer Science and Game Theory,Optimization and Control
An approximation theory of matrix rank minimization and its application to quadratic equations

Yun-Bin Zhao

DOI: https://doi.org/10.1016/j.laa.2012.02.021

IF: 1.307

2012-07-01

Linear Algebra and its Applications

Abstract:Matrix rank minimization problems are gaining plenty of recent attention in both mathematical and engineering fields. This class of problems, arising in various and across-discipline applications, is known to be NP-hard in general. In this paper, we aim at providing an approximation theory for the rank minimization problem, and prove that a rank minimization problem can be approximated to any level of accuracy via continuous optimization (especially, linear and nonlinear semidefinite programming) problems. One of the main results in this paper shows that if the feasible set of the problem has a minimum rank element with the least Frobenius norm, then any accumulation point of solutions to the approximation problem, as the approximation parameter tends to zero, is a minimum rank solution of the original problem. The tractability under certain conditions and convex relaxation of the approximation problem are also discussed. An immediate application of this theory to the system of quadratic equations is presented in this paper. It turns out that the condition for such a system without a nonzero solution can be characterized by a rank minimization problem, and thus the proposed approximation theory can be used to establish some sufficient conditions for the system to possess only zero solution.

mathematics, applied
Fenton type minimax problems for sum of translates functions

Bálint Farkas,Béla NAgy,Szilárd Gy. Révész

2023-06-29

Abstract:Following P. Fenton, we investigate sum of translates functions $F(\mathbf{x},t):=J(t)+\sum_{j=1}^n \nu_j K(t-x_j)$, where $J:[0,1]\to {\underline{\mathbb{R}}}:=\mathbb{R}\cup\{-\infty\}$ is a "sufficiently non-degenerate" and upper-bounded "field function", and $K:[-1,1]\to {\underline{\mathbb{R}}}$ is a fixed "kernel function", concave both on $(-1,0)$ and $(0,1)$, $\mathbf{x}:=(x_1,\ldots,x_n)$ with $0\le x_1\le\dots\le x_n\le 1$, and $\nu_1,\dots,\nu_n>0$ are fixed. We analyze the behavior of the local maxima vector $\mathbf{m}:=(m_0,m_1,\ldots,m_n)$, where $m_j:=m_j(\mathbf{x}):=\sup_{x_j\le t\le x_{j+1}} F(\mathbf{x},t)$, with $x_0:=0$, $x_{n+1}:=1$; and study the optimization (minimax and maximin) problems $\inf_{\mathbf{x}}\max_j m_j(\mathbf{x})$ and $\sup_{\mathbf{x}}\min_j m_j(\mathbf{x})$. The main result is the equality of these quantities, and provided $J$ is upper semicontinuous, the existence of extremal configurations and their description as equioscillation points $\mathbf{w}$. In our previous papers we obtained results for the case of singular kernels, i.e., when $K(0)=-\infty$ and the field $J$ was assumed to be upper semicontinuous. In this work we get rid of these assumptions and prove common generalizations of Fenton's and our previous results, arriving at the greatest generality in the setting of concave kernel functions.

Classical Analysis and ODEs
Minimization of differential equations and algebraic values of $E$-functions

Alin Bostan,Tanguy Rivoal,Bruno Salvy

2023-07-18

Abstract:A power series being given as the solution of a linear differential equation with appropriate initial conditions, minimization consists in finding a non-trivial linear differential equation of minimal order having this power series as a solution. This problem exists in both homogeneous and inhomogeneous variants; it is distinct from, but related to, the classical problem of factorization of differential operators. Recently, minimization has found applications in Transcendental Number Theory, more specifically in the computation of non-zero algebraic points where Siegel's $E$-functions take algebraic values. We present algorithms and implementations for these questions, and discuss examples and experiments.

Symbolic Computation,Number Theory
On the equivalence between the minimax theorem and strong duality of conic linear programming

Nikos Dimou

2024-08-24

Abstract:We prove the almost equivalence between two-player zero-sum games and conic linear programming problems in reflexive Banach spaces. The previous fundamental results of von Neumann, Dantzig, Adler, and von Stengel on the equivalence between linear programming and finite games with strategy sets defined over $\mathbb{R}^n$, are therefore extended to more general strategy spaces. More specifically, we show that for every two-player zero-sum game with a bilinear payoff function of the form $u(x,y)=\langle y,Ax\rangle$, for some linear operator $A$, and strategy sets that represent bases of convex cones, the minimax theorem holds, and its game value and Nash equilibria can be computed by solving a primal-dual pair of conic linear problems. Conversely, the minimax theorem for the same class of games "almost always" implies strong duality of conic linear programming. The main results are applied to a number of infinite zero-sum games, whose classes include those of semi-infinite, semidefinite, time-continuous, quantum, polynomial, and homogeneous separable games.

Optimization and Control,Computer Science and Game Theory
A Generalization of von Neumann's Reduction from the Assignment Problem to Zero-Sum Games

Ilan Adler,Martin Bullinger,Vijay V. Vazirani

2024-10-15

Abstract:The equivalence between von Neumann's Minimax Theorem for zero-sum games and the LP Duality Theorem connects cornerstone problems of the two fields of game theory and optimization, respectively, and has been the subject of intense scrutiny for seven decades. Yet, as observed in this paper, the proof of the difficult direction of this equivalence is unsatisfactory: It does not assign distinct roles to the two players of the game, as is natural from the definition of a zero-sum game. In retrospect, a partial resolution to this predicament was provided in another brilliant paper of von Neumann (1953), which reduced the assignment problem to zero-sum games. However, the underlying LP is highly specialized; all entries of its objective function vector are strictly positive and all entries of the constraint matrix and right hand side vector are equal to one. We generalize von Neumann's result along two directions, each allowing negative entries in certain parts of the LP. Our reductions make explicit the roles of the two players of the reduced game, namely their maximin strategies are to play optimal solutions to the primal and dual LPs. Furthermore, unlike previous reductions, the value of the reduced game reveals the value of the given LP. Our generalizations encompass several basic economic scenarios. We end by discussing evidence that von Neumann possessed an understanding of the notion of polynomial-time solvability.

Computer Science and Game Theory,Data Structures and Algorithms,Theoretical Economics
An elementary proof of linear programming optimality conditions without using Farkas' lemma

Anders Forsgren,Margaret H. Wright

DOI: https://doi.org/10.48550/arXiv.1407.1240

2014-07-04

Optimization and Control

Abstract:Although it is easy to prove the sufficient conditions for optimality of a linear program, the necessary conditions pose a pedagogical challenge. A widespread practice in deriving the necessary conditions is to invoke Farkas' lemma, but proofs of Farkas' lemma typically involve "nonlinear" topics such as separating hyperplanes between disjoint convex sets, or else more advanced LP-related material such as duality and anti-cycling strategies in the simplex method. An alternative approach taken previously by several authors is to avoid Farkas' lemma through a direct proof of the necessary conditions. In that spirit, this paper presents what we believe to be an "elementary" proof of the necessary conditions that does not rely on Farkas' lemma and is independent of the simplex method, relying only on linear algebra and a perturbation technique published in 1952 by Charnes. No claim is made that the results are new, but we hope that the proofs may be useful for those who teach linear programming.
A non-convex relaxed version of minimax theorems

M.I.A. Ghitri,A. Hantoute

2023-08-18

Abstract:Given a subset $A\times B$ of a locally convex space $X\times Y$ (with $A$ compact) and a function $f:A\times B\rightarrow\overline{\mathbb{R}}$ such that $f(\cdot,y),$ $y\in B,$ are concave and upper semicontinuous, the minimax inequality $\max_{x\in A} \inf_{y\in B} f(x,y) \geq \inf_{y\in B} \sup_{x\in A_{0}} f(x,y)$ is shown to hold provided that $A_{0}$ be the set of $x\in A$ such that $f(x,\cdot)$ is proper, convex and lower semi-contiuous. Moreover, if in addition $A\times B\subset f^{-1}(\mathbb{R})$, then we can take as $A_{0}$ the set of $x\in A$ such that $f(x,\cdot)$ is convex. The relation to Moreau's biconjugate representation theorem is discussed, and some applications to\ convex duality are provided. Key words. Minimax theorem, Moreau theorem, conjugate function, convex optimization.

Optimization and Control
Simple Strategies for Large Zero-Sum Games with Applications to Complexity Theory

Richard Lipton,Neal E. Young

DOI: https://doi.org/10.48550/arXiv.cs/0205035

2002-05-18

Computational Complexity

Abstract:Von Neumann's Min-Max Theorem guarantees that each player of a zero-sum matrix game has an optimal mixed strategy. This paper gives an elementary proof that each player has a near-optimal mixed strategy that chooses uniformly at random from a multiset of pure strategies of size logarithmic in the number of pure strategies available to the opponent. For exponentially large games, for which even representing an optimal mixed strategy can require exponential space, it follows that there are near-optimal, linear-size strategies. These strategies are easy to play and serve as small witnesses to the approximate value of the game. As a corollary, it follows that every language has small ``hard'' multisets of inputs certifying that small circuits can't decide the language. For example, if SAT does not have polynomial-size circuits, then, for each n and c, there is a set of n^(O(c)) Boolean formulae of size n such that no circuit of size n^c (or algorithm running in time n^c) classifies more than two-thirds of the formulae succesfully.
Fourier optimization, the least quadratic non-residue, and the least prime in an arithmetic progression

Emanuel Carneiro,Micah B. Milinovich,Emily Quesada-Herrera,Antonio Pedro Ramos

2024-04-12

Abstract:By means of a Fourier optimization framework, we improve the current asymptotic bounds under GRH for two classical problems in number theory: the problem of estimating the least quadratic non-residue modulo a prime, and the problem of estimating the least prime in an arithmetic progression.

Number Theory,Classical Analysis and ODEs
Making proofs without Modus Ponens: An introduction to the combinatorics and complexity of cut elimination

Alessandra Carbone,S. Semmes

DOI: https://doi.org/10.48550/arXiv.math/9607204

1996-07-05

Abstract:This paper is intended to provide an introduction to cut elimination which is accessible to a broad mathematical audience. Gentzen's cut elimination theorem is not as well known as it deserves to be, and it is tied to a lot of interesting mathematical structure. In particular we try to indicate some dynamical and combinatorial aspects of cut elimination, as well as its connections to complexity theory. We discuss two concrete examples where one can see the structure of short proofs with cuts, one concerning feasible numbers and the other concerning "bounded mean oscillation" from real analysis.

Logic
Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization

Benjamin Recht,Maryam Fazel,Pablo A. Parrilo

DOI: https://doi.org/10.1137/070697835

IF: 10.2

2010-01-01

SIAM Review

Abstract:The affine rank minimization problem consists of finding a matrix of minimum rank that satisfies a given system of linear equality constraints. Such problems have appeared in the literature of a diverse set of fields including system identification and control, Euclidean embedding, and collaborative filtering. Although specific instances can often be solved with specialized algorithms, the general affine rank minimization problem is NP-hard because it contains vector cardinality minimization as a special case. In this paper, we show that if a certain restricted isometry property holds for the linear transformation defining the constraints, the minimum-rank solution can be recovered by solving a convex optimization problem, namely, the minimization of the nuclear norm over the given affine space. We present several random ensembles of equations where the restricted isometry property holds with overwhelming probability, provided the codimension of the subspace is sufficiently large. The techniques used in our analysis have strong parallels in the compressed sensing framework. We discuss how affine rank minimization generalizes this preexisting concept and outline a dictionary relating concepts from cardinality minimization to those of rank minimization. We also discuss several algorithmic approaches to minimizing the nuclear norm and illustrate our results with numerical examples.

mathematics, applied
On Minor Left Prime Factorization Problem for Multivariate Polynomial Matrices

Dong Lu,Dingkang Wang,Fanghui Xiao

DOI: https://doi.org/10.1007/s11424-024-1367-5

2024-04-09

Journal of Systems Science and Complexity

Abstract:A new necessary and sufficient condition for the existence of minor left prime factorizations of multivariate polynomial matrices without full row rank is presented. The key idea is to establish a relationship between a matrix and any of its full row rank submatrices. Based on the new result, the authors propose an algorithm for factorizing matrices and have implemented it on the computer algebra system Maple. Two examples are given to illustrate the effectiveness of the algorithm, and experimental data shows that the algorithm is efficient.

mathematics, interdisciplinary applications
Miscellaneous applications of certain minimax theorems II

Biagio Ricceri

DOI: https://doi.org/10.48550/arXiv.1810.08957

2019-07-11

Abstract:In this paper, we present new applications of our general minimax theorems. In particular, one of them concerns the multiplicity of global minima for the integral functional of the Calculus of Variations.

Optimization and Control,Functional Analysis

Von Neumann's minimax theorem through Fourier-Motzkin elimination

A Simpler Approach to Linear Programming

A one-line proof of a minimax theorem (for a notion of curvature on finite graphs)

Notes on Equivalence and Minimization of Weighted Automata

Minimax and maximin problems for sums of translates on the real axis

THE ANALYTIC SOLUTIONS OF A CLASS OF CONSTRAINED MATRIX MINIMIZATION AND MAXIMIZATION PROBLEMS WITH APPLICATIONS

Nash Equilibrium and Minimax Theorems via Variational Tools of Convex Analysis

Zero-Sum Games and Linear Programming Duality

An approximation theory of matrix rank minimization and its application to quadratic equations

Fenton type minimax problems for sum of translates functions

Minimization of differential equations and algebraic values of $E$-functions

On the equivalence between the minimax theorem and strong duality of conic linear programming

A Generalization of von Neumann's Reduction from the Assignment Problem to Zero-Sum Games

An elementary proof of linear programming optimality conditions without using Farkas' lemma

A non-convex relaxed version of minimax theorems

Simple Strategies for Large Zero-Sum Games with Applications to Complexity Theory

Fourier optimization, the least quadratic non-residue, and the least prime in an arithmetic progression

Making proofs without Modus Ponens: An introduction to the combinatorics and complexity of cut elimination

Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization

On Minor Left Prime Factorization Problem for Multivariate Polynomial Matrices

Miscellaneous applications of certain minimax theorems II