On an optimal problem of bilinear forms

Naihuan Jing,Yibo Liu,Jiacheng Sun,Chengrui Zhao,Haoran Zhu

2024-02-14

Abstract:We study an optimization problem originated from the Grothendieck constant. A generalized normal equation is proposed and analyzed. We establish a correspondence between solutions of the general normal equation and its dual equation. Explicit solutions are described for the two-dimensional case.

Functional Analysis,Rings and Algebras

What problem does this paper attempt to address?

On the Planar Dual Minkowski Problem

Shibing Chen,Qi-Rui Li

DOI: https://doi.org/10.1016/j.aim.2018.05.010

IF: 1.675

2018-01-01

Advances in Mathematics

Abstract:In this paper, we resolve the planar dual Minkowski problem, proposed by Huang et al. (2016) [31] for all positive indices without any symmetry assumption. More precisely, given any q>0, and function f on S1, bounded by two positive constants, we show that there exists a convex body Ω in the plane, containing the origin in its interior, whose dual curvature measure C˜q(Ω,⋅) has density f. In particular, if f is smooth, then ∂Ω is also smooth.
On the Least Squares Solutions of a System of Bilinear Equations

Bai, E.-W.,Yun Liu

DOI: https://doi.org/10.1109/CDC.2005.1582321

2005-01-01

Abstract:The problem of finding a least squares solution for a system of bilinear equations is investigated. Suffcient conditions to have a unique minimum are given in the cases of random inputs. Three methods, the normalized iterative method, the over-parametrization method and the numerical method are presented for solving the least squares problem along with their convergence properties. Simulation examples are provided.
Least squares solutions of bilinear equations

Er-Wei Bai,Yun Liu

DOI: https://doi.org/10.1016/j.sysconle.2005.09.010

IF: 2.742

2006-01-01

Systems & Control Letters

Abstract:The problem of finding a least squares solution for a system of bilinear equations is investigated. Sufficient conditions to have a unique minimum are given in the case of random inputs. Three methods, the normalized iterative method, the over-parameterization method and the numerical method are presented for solving the problem along with their convergence properties. Simulation examples are provided.
Optimal solutions to a class of nonconvex minimization problems with linear inequality constraints

Yubo Yuan

DOI: https://doi.org/10.1016/j.amc.2008.04.016

IF: 4.397

2008-01-01

Applied Mathematics and Computation

Abstract:This paper presents a canonical duality theory and optimal solutions to a class of global optimization problems subjected to linear inequality constraints. By using the canonical dual transformation developed recently, a canonical dual problem is formulated, which is perfectly dual to the primal problem. The global minmizer can be identified by the triality theory. Results show that if the global extrema of the original problem are located on the boundary of the primal feasible space, the dual solution should be interior point of the dual feasible set. Several examples are illustrated to show how this theory works.
Bilinear forms, Schur multipliers, complete boundedness and duality

Erik Christensen

DOI: https://doi.org/10.48550/arXiv.2301.05005

2023-01-12

Abstract:Grothendieck's inequalities for operators and bilinear forms imply some factorization results for complex m x n matrices. Based on the theory of operator spaces and completely bounded mappings we present norm optimal versions of these results and two norm optimal factorization results related to the Schur product. We show that the spaces of respectively bilinear forms and Schur multipliers are conjugate duals to each other with respect to their completely bounded norms.

Functional Analysis,Operator Algebras
On Linear Convergence in Smooth Convex-Concave Bilinearly-Coupled Saddle-Point Optimization: Lower Bounds and Optimal Algorithms

Dmitry Kovalev,Ekaterina Borodich

2024-11-22

Abstract:We revisit the smooth convex-concave bilinearly-coupled saddle-point problem of the form $\min_x\max_y f(x) + \langle y,\mathbf{B} x\rangle - g(y)$. In the highly specific case where each of the functions $f(x)$ and $g(y)$ is either affine or strongly convex, there exist lower bounds on the number of gradient evaluations and matrix-vector multiplications required to solve the problem, as well as matching optimal algorithms. A notable aspect of these algorithms is that they are able to attain linear convergence, i.e., the number of iterations required to solve the problem is proportional to $\log(1/\epsilon)$. However, the class of bilinearly-coupled saddle-point problems for which linear convergence is possible is much wider and can involve smooth non-strongly convex functions $f(x)$ and $g(y)$. Therefore, we develop the first lower complexity bounds and matching optimal linearly converging algorithms for this problem class. Our lower complexity bounds are much more general, but they cover and unify the existing results in the literature. On the other hand, our algorithm implements the separation of complexities, which, for the first time, enables the simultaneous achievement of both optimal gradient evaluation and matrix-vector multiplication complexities, resulting in the best theoretical performance to date.

Optimization and Control,Machine Learning
Efficient treatment of bilinear forms in global optimization

Marcia Fampa,Jon Lee

DOI: https://doi.org/10.48550/arXiv.1803.07625

2018-03-21

Abstract:We efficiently treat bilinear forms in the context of global optimization, by applying McCormick convexification and by extending an approach of Saxena, Bonami and Lee for symmetric quadratic forms to bilinear forms. A key application of our work is in treating "structural convexity" in a symmetric quadratic form.

Optimization and Control
The Dual Normal Chip and Linear Regularity for Infinite Systems of Convex Sets in Banach Spaces

Chong Li,K. F. Ng

DOI: https://doi.org/10.1137/130941493

IF: 2.763

2014-01-01

SIAM Journal on Optimization

Abstract:For an indexed collection of convex sets in a Banach space with index set $I$of cardinality $|I|$ of $I$, which may be finite or infinite,we investigate the interrelationship between various qualification notionsincluding the linear regularity, the normal property, the dual normalconical hull intersection property,and Jameson's property $(G)$, together with their quantitative versions,and thereby we extend the well-known results of Bakan, Deutsch, andLi [ Trans. Amer. Math. Soc. , 357 (2005), pp. 3831--3863],and Bauschke, Borwein, and Li [ Math. Program. Ser. A , 86 (1999), pp. 135--160] fromthe finite case to the more general case that allows $|I|$ to be infinite.
Existence of Optimal Shapes in Parabolic Bilinear Optimal Control Problems

Idriss Mazari-Fouquer

DOI: https://doi.org/10.1007/s00205-024-01958-0

2024-02-17

Archive for Rational Mechanics and Analysis

Abstract:The aim of this paper is to prove the existence of optimal shapes in bilinear parabolic optimal control problems. We consider a parabolic equation . The set of admissible controls is given by , where are two reference functions in , and where is a reference integral constraint. The functional to optimise is . Roughly speaking, we prove that, if and are non-decreasing and if one is increasing, then any solution of is bang-bang: any optimal writes for some . From the point of view of shape optimization, this is a parabolic analog of the Buttazzo-Dal Maso theorem in shape optimisation. The proof is based on second-order criteria and on an approximation-localisation procedure for admissible perturbations. This last part uses the theory of parabolic equations with measure data.

mathematics, applied,mechanics
Contractivity and linear convergence in bilinear saddle-point problems: An operator-theoretic approach

Colin Dirren,Mattia Bianchi,Panagiotis D. Grontas,John Lygeros,Florian Dörfler

2024-10-19

Abstract:We study the convex-concave bilinear saddle-point problem $\min_x \max_y f(x) + y^\top Ax - g(y)$, where both, only one, or none of the functions $f$ and $g$ are strongly convex, and suitable rank conditions on the matrix $A$ hold. The solution of this problem is at the core of many machine learning tasks. By employing tools from operator theory, we systematically prove the contractivity (in turn, the linear convergence) of several first-order primal-dual algorithms, including the Chambolle-Pock method. Our approach results in concise and elegant proofs, and it yields new convergence guarantees and tighter bounds compared to known results.

Optimization and Control,Machine Learning
The Bilinear Bochner-Riesz Problem

Frédéric Bernicot,Loukas Grafakos,Liang Song,Lixin Yan

DOI: https://doi.org/10.1007/s11854-015-0028-y

2015-01-01

Abstract:Motivated by the problem of spherical summability of products of Fourier series, we study the boundedness of the bilinear Bochner-Riesz multipliers $(1 - {\left| \xi \right|^2} - {\left| \eta \right|^2})_ + ^\delta $ and make some advances in this investigation. We obtain an optimal result concerning the boundedness of these means from L 2 × L 2 into L 1 with minimal smoothness, i.e., any δ > 0, and we obtain estimates for other pairs of spaces for larger values of δ. Our study is broad enough to encompass general bilinear multipliers m(ξ, η) radial in ξ and η with minimal smoothness, measured in Sobolev space norms. The results obtained are based on a variety of techniques that include Fourier series expansions, orthogonality, and bilinear restriction and extension theorems.
An Online Learning Algorithm for Bilinear Models

Yuanbin Wu,Shiliang Sun

2015-01-01

Abstract:We investigate the bilinear model, which is a matrix form linear model with the rank 1 constraint. A new online learning algorithm is proposed to train the model parameters. Our algorithm runs in the manner of online mirror descent, and gradients are computed by the power iteration. To analyze it, we give a new second order approximation of the squared spectral norm, which helps us to get a regret bound. Experiments on two sequential labelling tasks give positive results.
Generalized Polyhedral Convex Optimization Problems

Nguyen Ngoc Luan,Jen-Chih Yao

DOI: https://doi.org/10.48550/arXiv.1709.10227

2017-09-29

Abstract:Generalized polyhedral convex optimization problems in locally convex Hausdorff topological vector spaces are studied systematically in this paper. We establish solution existence theorems, necessary and sufficient optimality conditions, weak and strong duality theorems. In particular, we show that the dual problem has the same structure as the primal problem, and the strong duality relation holds under three different sets of conditions.

Optimization and Control
Canonical Solutions to Nonconvex Minimization Problems over Lorentz Cone

Ning Ruan,David Yang Gao

DOI: https://doi.org/10.48550/arXiv.1210.5300

2012-10-19

Abstract:This paper presents a canonical dual approach for solving nonconvex quadratic minimization problem. By using the canonical duality theory, nonconvex primal minimization problems over n-dimensional Lorentz cone can be transformed into certain canonical dual problems with only one dual variable, which can be solved by using standard convex minimization methods. Extremality conditions of these solutions are classified by the triality theory. Applications are illustrated.

Optimization and Control
Optimality Conditions and Complexity for Non-Lipschitz Constrained Optimization Problems

Wei Bian,Xiaojun Chen

2014-01-01

Abstract:In this paper, we consider a class of nonsmooth, nonconvex constrained optimization problems where the objective function may be not Lipschitz continuous and the feasible set is a general closed convex set. Using the theory of the generalized directional derivative and the Clarke tangent cone, we derive a first order necessary optimality condition for local minimizers of the problem, and define the generalized stationary point of it. The generalized stationary point is the Clarke stationary point when the objective function is Lipschitz continuous at this point, and the scaled stationary point in the existing literature when the objective function is not Lipschitz continuous at this point. We prove the consistency between the generalized directional derivative and the limit of the classic directional derivatives associated with the smoothing function. Moreover we present the computational complexity and lower bound theory of the problem.
On positive solutions of biharmonic elliptic inequalities on Riemannian manifolds

Yuhua Sun,Yadong Zheng

DOI: https://doi.org/10.3934/cpaa.2024089

2024-10-12

Communications on Pure & Applied Analysis

Abstract:We investigate the existence and nonexistence of positive solutions to biharmonic elliptic inequalities on different domains of manifolds, including exterior domains and whole spaces. Using Green function and volume growth conditions, we establish the critical exponent for the existence and nonexistence of positive solutions to such biharmonic problem.

mathematics, applied
On generalized surrogate duality in mixed-integer nonlinear programming

Benjamin Müller,Gonzalo Muñoz,Maxime Gasse,Ambros Gleixner,Andrea Lodi,Felipe Serrano

DOI: https://doi.org/10.1007/s10107-021-01691-6

IF: 2.7

2021-07-17

Mathematical Programming

Abstract:Abstract The most important ingredient for solving mixed-integer nonlinear programs (MINLPs) to global $$\epsilon $$ ε -optimality with spatial branch and bound is a tight, computationally tractable relaxation. Due to both theoretical and practical considerations, relaxations of MINLPs are usually required to be convex. Nonetheless, current optimization solvers can often successfully handle a moderate presence of nonconvexities, which opens the door for the use of potentially tighter nonconvex relaxations. In this work, we exploit this fact and make use of a nonconvex relaxation obtained via aggregation of constraints: a surrogate relaxation. These relaxations were actively studied for linear integer programs in the 70s and 80s, but they have been scarcely considered since. We revisit these relaxations in an MINLP setting and show the computational benefits and challenges they can have. Additionally, we study a generalization of such relaxation that allows for multiple aggregations simultaneously and present the first algorithm that is capable of computing the best set of aggregations. We propose a multitude of computational enhancements for improving its practical performance and evaluate the algorithm’s ability to generate strong dual bounds through extensive computational experiments.

mathematics, applied,computer science, software engineering,operations research & management science
Optimality conditions for the nonlinear programming problems on Riemannian manifolds

Wei Hong Yang,Lei-Hong Zhang,Ruyi Song

2012-01-01

Pacific journal of optimization

Abstract:In recent years, many traditional optimization methods have been successfully generalized to minimize objective functions on manifolds. In this paper, we first extend the general traditional constrained optimization problem to a nonlinear programming problem built upon a general Riemannian manifold M , and discuss the first-order and the second-order optimality conditions. By exploiting the differential geometry structure of the underlying manifold M , we show that, in the language of differential geometry, the first-order and the second-order optimality conditions of the nonlinear programming problem on M coincide with the traditional optimality conditions. When the objective function is nonsmooth Lipschitz continuous, we extend the Clarke generalized gradient, tangent and normal cone, and establish the first-order optimality conditions. For the case when M is an embedded submanifold of Rm, formed by a set of equality constraints, we show that the optimality conditions can be derived directly from the traditional results on Rm.
Canonical Dual Solutions to Quadratic Optimization over One Quadratic Constraint.

Wenxun Xing,Shu-Cherng Fang,Ruey-Lin Sheu,Liping Zhang

DOI: https://doi.org/10.1142/s0217595915400072

2015-01-01

Abstract:A quadratic optimization problem with one nonconvex quadratic constraint is studied using the canonical dual approach. Under the dual Slater's condition, we show that the canonical dual has a smooth concave objective function over a convex feasible domain, and this dual has a finite supremum unless the original quadratic optimization problem is infeasible. This supremum, when it exists, always equals to the minimum value of the primal problem. Moreover, a global minimizer of the primal problem can be provided by a dual-to-primal conversion plus a "boundarification" technique. Application to solving a quadratic programming problem over a ball is included and an error bound estimation is provided.
Bilinearization Ofn= 1 Supersymmetric Korteweg–de Vries Equation Revisited

QP Liu,XB Hu

DOI: https://doi.org/10.1088/0305-4470/38/28/009

2005-01-01

Abstract:We consider the N = 1 supersymmetric Korteweg-de Vries (sKdV) equation within the framework of Hirota's bilinear method. We construct a Backlund transformation which may be interpreted as the modified sKdV equation. Also, we find a Lax representation and a nonlinear superposition formula. By direct applications of the nonlinear superposition formula, we calculate soliton solutions for the sKdV equation.

On an optimal problem of bilinear forms

On the Planar Dual Minkowski Problem

On the Least Squares Solutions of a System of Bilinear Equations

Least squares solutions of bilinear equations

Optimal solutions to a class of nonconvex minimization problems with linear inequality constraints

Bilinear forms, Schur multipliers, complete boundedness and duality

On Linear Convergence in Smooth Convex-Concave Bilinearly-Coupled Saddle-Point Optimization: Lower Bounds and Optimal Algorithms

Efficient treatment of bilinear forms in global optimization

The Dual Normal Chip and Linear Regularity for Infinite Systems of Convex Sets in Banach Spaces

Existence of Optimal Shapes in Parabolic Bilinear Optimal Control Problems

Contractivity and linear convergence in bilinear saddle-point problems: An operator-theoretic approach

The Bilinear Bochner-Riesz Problem

An Online Learning Algorithm for Bilinear Models

Generalized Polyhedral Convex Optimization Problems

Canonical Solutions to Nonconvex Minimization Problems over Lorentz Cone

Optimality Conditions and Complexity for Non-Lipschitz Constrained Optimization Problems

On positive solutions of biharmonic elliptic inequalities on Riemannian manifolds

On generalized surrogate duality in mixed-integer nonlinear programming

Optimality conditions for the nonlinear programming problems on Riemannian manifolds

Canonical Dual Solutions to Quadratic Optimization over One Quadratic Constraint.

Bilinearization Ofn= 1 Supersymmetric Korteweg–de Vries Equation Revisited