Eigenvalue programming beyond matrices

Masaru Ito,Bruno F. Lourenço
2024-04-17
Abstract:In this paper we analyze and solve eigenvalue programs, which consist of the task of minimizing a function subject to constraints on the "eigenvalues" of the decision variable. Here, by making use of the FTvN systems framework introduced by Gowda, we interpret "eigenvalues" in a broad fashion going beyond the usual eigenvalues of matrices. This allows us to shed new light on classical problems such as inverse eigenvalue problems and also leads to new applications. In particular, after analyzing and developing a simple projected gradient algorithm for general eigenvalue programs, we show that eigenvalue programs can be used to express what we call vanishing quadratic constraints. A vanishing quadratic constraint requires that a given system of convex quadratic inequalities be satisfied and at least a certain number of those inequalities must be tight. As a particular case, this includes the problem of finding a point $x$ in the intersection of $m$ ellipsoids in such a way that $x$ is also in the boundary of at least $\ell$ of the ellipsoids, for some fixed $\ell > 0$. At the end, we also present some numerical experiments.
Optimization and Control
What problem does this paper attempt to address?
This paper aims to solve a class of optimization problems, namely Eigenvalue Programming. Specifically, the goal of such problems is to minimize a function when the "eigenvalues" of decision variables satisfy certain constraints. Here, the "eigenvalues" are not limited to the eigenvalues of matrices, but are generally defined through the FTvN system framework and can be applied to a wider range of mathematical objects. ### Problems the paper attempts to solve 1. **Optimization problems under generalized eigenvalue constraints**: - The paper studies how to minimize a smooth function \( f \) when the "eigenvalues" of decision variables are constrained by a specific set \( C \). Formally, the problem can be expressed as: \[ \min_{x \in E} f(x) \quad \text{subject to} \quad \lambda(x) \in C, \] where \( E \) is a finite - dimensional Euclidean space, \( \lambda: E \to \mathbb{R}^r \) is the so - called "eigenvalue mapping", and \( C\subseteq \mathbb{R}^r \) is a given set. 2. **Handling non - convex optimization problems**: - Since eigenvalue constraints may lead to highly non - convex problems, the paper explores how to use the theoretical results of the FTvN system to transform such problems into more tractable forms. For example, linear optimization problems can be simplified by projecting onto \( \lambda^{-1}(C) \). 3. **Exploration of new applications**: - The paper shows the potential of eigenvalue programming in solving some classical problems (such as the inverse eigenvalue problem) and new applications (such as the vanishing quadratic constraint problem). In particular, the paper proposes a simple projection gradient algorithm to solve general eigenvalue programming problems and discusses its applications in geometric and optimization problems. ### Main contributions 1. **Analysis and implementation of the projection gradient algorithm**: - The paper uses the FTvN system framework to analyze and implement a simple projection gradient algorithm for solving eigenvalue programming problems. 2. **Discussion of modeling capabilities**: - The paper discusses in detail the modeling capabilities of eigenvalue programming, including re - examining the inverse eigenvalue problem and solving the feasibility problem with vanishing quadratic constraints. In particular, the paper shows how to find an intersection point in multiple ellipsoids such that it lies on the boundaries of at least \( \ell \) ellipsoids. ### Conclusion By introducing the FTvN system framework, the paper provides a broad and simple framework for solving optimization problems with eigenvalue constraints. This not only covers traditional matrix eigenvalue problems but also extends to more general mathematical objects. Through the projection gradient algorithm and the modeling of the vanishing quadratic constraint problem, the paper shows the broad application prospects of eigenvalue programming in the field of optimization.