UniCalc.LIN: a linear constraint solver for the UniCalc system

E. Petrov,Yu. Kostov,E. Botoeva

DOI: https://doi.org/10.48550/arXiv.cs/0604038

2006-04-10

Mathematical Software

Abstract:In this short paper we present a linear constraint solver for the UniCalc system, an environment for reliable solution of mathematical modeling problems.

What problem does this paper attempt to address?

Solving Mathematical Programs with Equilibrium Constraints

Lei Guo,Gui-Hua Lin,Jane J. Ye

DOI: https://doi.org/10.1007/s10957-014-0699-z

2015-01-01

Journal of Optimization Theory and Applications

Abstract:This paper aims at developing effective numerical methods for solving mathematical programs with equilibrium constraints. Due to the existence of complementarity constraints, the usual constraint qualifications do not hold at any feasible point, and there are various stationarity concepts such as Clarke, Mordukhovich, and strong stationarities that are specially defined for mathematical programs with equilibrium constraints. However, since these stationarity systems contain some unknown index sets, there has been no numerical method for solving them directly. In this paper, we remove the unknown index sets from these stationarity systems successfully, and reformulate them as smooth equations with box constraints. We further present a modified Levenberg–Marquardt method for solving these constrained equations. We show that, under some weak local error bound conditions, the method is locally and superlinearly convergent. Furthermore, we give some sufficient conditions for local error bounds, and show that these conditions are not very stringent by a number of examples.
A Unified Tool for Solving Uni-Parametric Linear Programs, Convex Quadratic Programs, and Linear Complementarity Problems

Nathan Adelgren

DOI: https://doi.org/10.48550/arXiv.2203.13135

2022-03-24

Optimization and Control

Abstract:We introduce a new technique for solving uni-parametric versions of linear programs, convex quadratic programs, and linear complementarity problems in which a single parameter is permitted to be present in any of the input data. We demonstrate the use of our method on a small, motivating example and present the results of a small number of computational tests demonstrating its utility for larger scale problems.
Structured Regularization In Barrier Nlp For Optimization Models With Dependent Constraints

kexin wang,zhijiang shao,lorenz t biegler,yidong lang,jixin qian

DOI: https://doi.org/10.1016/B978-0-444-59506-5.50131-0

2012-01-01

Abstract:Global convergence and fast performance of barrier nonlinear programming (NLP) solvers are frequently challenged by linearly dependent constraints. Such constraints arise in many process optimization models, and they often preclude finding successful NLP solutions. To deal with this problem we present a structured regularization strategy for barrier methods that identifies and excludes dependent constraints in the KKT system while leaving independent constraints unchanged. As a result, more accurate Newton directions can be obtained and much faster convergence can be expected for the KKT system over the conventional regularization approach. Numerical experiments with examples derived from the CUTE and COPS test sets as well as two refinery blending problems demonstrate the effectiveness of the proposed method and significantly better performance of the NLP solver.
Master–slave elimination scheme for arbitrary smooth nonlinear multi-point constraints

Jonas Boungard,Jens Wackerfuß

DOI: https://doi.org/10.1007/s00466-024-02463-7

IF: 4.391

2024-05-26

Computational Mechanics

Abstract:Nonlinear multi-point constraints are essential in modeling various engineering problems, for example in the context of (a) linking individual degrees of freedom of multiple nodes to model nonlinear joints, (b) coupling different element types in finite element analysis, (c) enforcing various types of rigidity in parts of the mesh and (d) considering deformation-dependent Dirichlet boundary conditions. One method for addressing constraints is the master–slave elimination, which offers the benefit of reducing the problem dimension as opposed to Lagrange multipliers and the penalty method. However, the existing master–slave elimination method is limited to linear constraints. In this paper, we introduce a new master–slave elimination method for handling arbitrary smooth nonlinear multi-point constraints in the system of equations of the discretized system. We present a rigorous mathematical derivation of the method. Within this method, new constraints can be easily considered as an item of a "constraint library"; i.e. no case-by-case-programming is required. In addition to the theoretical aspects, we also provide helpful remarks on the efficient implementation. Among others, we show that the new method results in a reduced computational complexity compared to the existing methods. The study also places emphasis on comparing the new approach with existing methods via numerical examples. We have developed innovative benchmarks which encompass all relevant computational properties, and provide analytical and reference solutions. Our findings demonstrate that our new method is as accurate, robust and flexible as the Lagrange multipliers, and more efficient due to the reduction of the total number of degrees of freedom, which is particularly advantageous when a large number of constraints have to be considered.

mechanics,mathematics, interdisciplinary applications
Design and Implementation of Large-scale Nonlinear Optimization Software UniOptima

JIANG Ai-peng,SHAO Zhi-jiang,QIAN Ji-xin

DOI: https://doi.org/10.3969/j.issn.1000-3932.2005.05.008

2005-01-01

Abstract:SQP algorithms are viewed as the best method for solving nonlinear problems,and when applied to solve large-scale problems,they can be classified as full-space methods and reduced space methods.Based on the two kinds of SQP algorithms,large-scale nonlinear optimization software named UniOptima is developed.In UniOptima there are two nonlinear solvers named RSQP and THSQP.RSQP is designed to solve large-scale problems with large number of equality constraints and relatively few degrees of freedom,and THSQP is designed to solve general nonlinear problems.The optimization software has many options for users to select,is developed under Matlab language and is compatible with the optimization tools in Matlab,which will largely increase the convenience for users.
On the Least Squares Solutions of a System of Bilinear Equations

Bai, E.-W.,Yun Liu

DOI: https://doi.org/10.1109/CDC.2005.1582321

2005-01-01

Abstract:The problem of finding a least squares solution for a system of bilinear equations is investigated. Suffcient conditions to have a unique minimum are given in the cases of random inputs. Three methods, the normalized iterative method, the over-parametrization method and the numerical method are presented for solving the least squares problem along with their convergence properties. Simulation examples are provided.
A version of the simplex method for solving linear systems of inequalities and linear programming problems

Jaan Übi,Evald Übi

2023-04-24

Abstract:In order to nd a non-negative solution to a system of inequalities, the corresponding dual problem is composed, which has a suitable unity basic matrix. In such a formulation, the objective function is replaced by set of constraints based on that function. Additional constraints can be used for accelerating calculations in the rst phase of the simplex method. As an example the solution of the Klee-Minty hypercube problem is described in detail.

Optimization and Control,Numerical Analysis
2D Geometric Constraint Solver

gao jianfeng,zhang shensheng,bu fenglin,zhao jiyun

DOI: https://doi.org/10.3321/j.issn:1003-9775.2000.02.007

2000-01-01

Abstract:The paper reports on the development of a 2D geometric constraint solver, which is a major component of a new generation intelligent CAD system. The solver takes a graph and rule oriented approach and achieves interactive speed. The paper presents the geometric constraint model and its graph representation, then discusses in detail the algorithms of geometric reasoning based on reduction, describes the architecture of the solver and its basic capabilities.
Unifying nonlinearly constrained nonconvex optimization

Charlie Vanaret,Sven Leyffer

2024-06-19

Abstract:Derivative-based iterative methods for nonlinearly constrained nonconvex optimization usually share common algorithmic components, such as strategies for computing a descent direction and mechanisms that promote global convergence. Based on this observation, we introduce an abstract framework based on four common ingredients that describes most derivative-based iterative methods and unifies their workflows. We then present Uno, a modular C++ solver that implements our abstract framework and allows the automatic generation of various strategy combinations with no programming effort from the user. Uno is meant to (1) organize mathematical optimization strategies into a coherent hierarchy; (2) offer a wide range of efficient and robust methods that can be compared for a given instance; (3) enable researchers to experiment with novel optimization strategies; and (4) reduce the cost of development and maintenance of multiple optimization solvers. Uno's software design allows user to compose new customized solvers for emerging optimization areas such as robust optimization or optimization problems with complementarity constraints, while building on reliable nonlinear optimization techniques. We demonstrate that Uno is highly competitive against state-of-the-art solvers filterSQP, IPOPT, SNOPT, MINOS, LANCELOT, LOQO, and CONOPT on a subset of 429 small problems from the CUTEst collection. Uno is available as open-source software under the MIT license at <a class="link-external link-https" href="https://github.com/cvanaret/Uno" rel="external noopener nofollow">this https URL</a> .

Optimization and Control
NonlinearSolve.jl: High-Performance and Robust Solvers for Systems of Nonlinear Equations in Julia

Avik Pal,Flemming Holtorf,Axel Larsson,Torkel Loman,Utkarsh,Frank Schäefer,Qingyu Qu,Alan Edelman,Chris Rackauckas

2024-03-28

Abstract:Efficiently solving nonlinear equations underpins numerous scientific and engineering disciplines, yet scaling these solutions for complex system models remains a challenge. This paper presents NonlinearSolve.jl - a suite of high-performance open-source nonlinear equation solvers implemented natively in the Julia programming language. NonlinearSolve.jl distinguishes itself by offering a unified API that accommodates a diverse range of solver specifications alongside features such as automatic algorithm selection based on runtime analysis, support for GPU-accelerated computation through static array kernels, and the utilization of sparse automatic differentiation and Jacobian-free Krylov methods for large-scale problem-solving. Through rigorous comparison with established tools such as Sundials and MINPACK, NonlinearSolve.jl demonstrates unparalleled robustness and efficiency, achieving significant advancements in solving benchmark problems and challenging real-world applications. The capabilities of NonlinearSolve.jl unlock new potentials in modeling and simulation across various domains, making it a valuable addition to the computational toolkit of researchers and practitioners alike.

Numerical Analysis
UNICON: A UNIform CONstraint Based Graph Layout Framework.

Jiacheng Yu,Yifan Hu,Xiaoru Yuan

DOI: https://doi.org/10.1109/pacificvis53943.2022.00015

2022-01-01

Abstract:We propose UNICON, a UNIform CONstraint based graph layout framework that supports both soft and hard constraints. We extend the stress model to accommodate soft constraints by incorporating them in the objective functions, optimized by stochastic gradient descent. For hard constraints, such as inequalities or equalities in the layout space, we utilize a gradient projection method to satisfy them. A visualization prototype system is implemented based on this framework for the user to interactively add or remove constraints to generate the desired layouts. We demonstrate the efficiency, quality, and flexibility of the framework and the system on a number of datasets with a wide range of user-defined constraints.
Nonlinear Programming Solvers for Unconstrained and Constrained Optimization Problems: a Benchmark Analysis

Giovanni Lavezzi,Kidus Guye,Marco Ciarcià

DOI: https://doi.org/10.48550/arXiv.2204.05297

2022-04-11

Optimization and Control

Abstract:In this paper we propose a set of guidelines to select a solver for the solution of nonlinear programming problems. With this in mind, we present a comparison of the convergence performances of commonly used solvers for both unconstrained and constrained nonlinear programming problems. The comparison involves accuracy, convergence rate, and convergence speed. Because of its popularity among research teams in academia and industry, MATLAB is used as common implementation platform for the solvers. Our study includes solvers which are either freely available, or require a license, or are fully described in literature. In addition, we differentiate solvers if they allow the selection of different optimal search methods. As result, we examine the performances of 23 algorithms to solve 60 benchmark problems. To enrich our analysis, we will describe how, and to what extent, convergence speed and accuracy can be improved by changing the inner settings of each solver.
Solving Hybrid Assembly Constraint Systems

Yt Li,Sm Hu,Jg Sun

2001-01-01

Abstract:This paper describes a 3-D assembly constraint solver capable of efficiently handling declarative and constructive constraints. The hybrid constraint systems are represented by constraint graphs and decomposed using bipartite matchings without weights. In the constraint evaluation phase, the optimization methods are adopted to solve the equations entailed. The proposed strategy has been implemented in a feature-based parametric CAD system of GEMS 5.0.
Least squares solutions of bilinear equations

Er-Wei Bai,Yun Liu

DOI: https://doi.org/10.1016/j.sysconle.2005.09.010

IF: 2.742

2006-01-01

Systems & Control Letters

Abstract:The problem of finding a least squares solution for a system of bilinear equations is investigated. Sufficient conditions to have a unique minimum are given in the case of random inputs. Three methods, the normalized iterative method, the over-parameterization method and the numerical method are presented for solving the problem along with their convergence properties. Simulation examples are provided.
Automation of Triangle Ruler-and-Compass Constructions Using Constraint Solvers

Milan Banković

DOI: https://doi.org/10.4204/EPTCS.398.10

2024-01-22

Abstract:In this paper, we present an approach to automated solving of triangle ruler-and-compass construction problems using finite-domain constraint solvers. The constraint model is described in the MiniZinc modeling language, and is based on the automated planning. The main benefit of using general constraint solvers for such purpose, instead of developing dedicated tools, is that we can rely on the efficient search that is already implemented within the solver, enabling us to focus on geometric aspects of the problem. We may also use the solver's built-in optimization capabilities to search for the shortest possible constructions. We evaluate our approach on 74 solvable problems from the Wernick's list, and compare it to the dedicated triangle construction solver ArgoTriCS. The results show that our approach is comparable to dedicated tools, while it requires much less effort to implement. Also, our model often finds shorter constructions, thanks to the optimization capabilities offered by the constraint solvers.

Artificial Intelligence
Towards Automatic Linearization via SMT Solving

Jian Cao,Liyong Lin,Lele Li

2024-08-24

Abstract:Mathematical optimization is ubiquitous in modern applications. However, in practice, we often need to use nonlinear optimization models, for which the existing optimization tools such as Cplex or Gurobi may not be directly applicable and an (error-prone) manual transformation often has to be done. Thus, to address this issue, in this paper we investigate the problem of automatically verifying and synthesizing reductions, the solution of which may allow an automatic linearization of nonlinear models. We show that the synthesis of reductions can be formulated as an $\exists^* \forall^*$ synthesis problem, which can be solved by an SMT solver via the counter-example guided inductive synthesis approach (CEGIS).

Logic in Computer Science,Systems and Control,Optimization and Control
Numerical methods of closed-loop multibody systems with singular configurations based on the geometrical structure of constraints

Yingpeng Zhuo,Zhaohui Qi,Gang Wang,Shudong Guo

DOI: https://doi.org/10.1007/s11044-021-09797-7

IF: 3.4

2021-08-02

Multibody System Dynamics

Abstract:The geometrical structure of constraints leads to the important conclusion that components of velocities and accelerations in the normal space of the constraint hypersurface are totally determined by the constraints. Orthogonal base vectors of the constraint's normal and tangent spaces can be obtained by the QR decomposition with column permutation. A numerical method of closed-loop multibody systems with singular configurations is presented, in which the traditional hypothesis on independence of constraints is abandoned. Instead of correcting constraint violations at the end of each integration step, positions and velocities are modified to satisfy their constraint equations before they are used to form equations of motion. Such an approach can collaborate with any standard ODE solver. In order to systematically generate constraint equations and obtain the corresponding joint's reaction forces, rotational and translational constraints of a closed-loop are standardized as part of six explicit equations, and a clear relationship between Lagrange multipliers and joint's reaction forces is derived based on the principle of virtual power equivalence. The proposed method can dynamically identify independent constraints and modify the equations of motion accordingly. The numerical examples validated its effectiveness.

mechanics
Linnea: Automatic Generation of Efficient Linear Algebra Programs

Henrik Barthels,Christos Psarras,Paolo Bientinesi

DOI: https://doi.org/10.48550/arXiv.1912.12924

2019-12-30

Abstract:The translation of linear algebra computations into efficient sequences of library calls is a non-trivial task that requires expertise in both linear algebra and high-performance computing. Almost all high-level languages and libraries for matrix computations (e.g., Matlab, Eigen) internally use optimized kernels such as those provided by BLAS and LAPACK; however, their translation algorithms are often too simplistic and thus lead to a suboptimal use of said kernels, resulting in significant performance losses. In order to combine the productivity offered by high-level languages, and the performance of low-level kernels, we are developing Linnea, a code generator for linear algebra problems. As input, Linnea takes a high-level description of a linear algebra problem; as output, it returns an efficient sequence of calls to high-performance kernels. Linnea uses a custom best-first search algorithm to find a first solution in less than a second, and increasingly better solutions when given more time. In 125 test problems, the code generated by Linnea almost always outperforms Matlab, Julia, Eigen and Armadillo, with speedups up to and exceeding 10x.

Mathematical Software
Calibrating Least Squares Semidefinite Programming with Equality and Inequality Constraints

Yan Gao,Defeng Sun

DOI: https://doi.org/10.1137/080727075

IF: 1.908

2010-01-01

SIAM Journal on Matrix Analysis and Applications

Abstract:In this paper, we consider the least squares semidefinite programming with a large number of equality and inequality constraints. One difficulty in finding an efficient method for solving this problem is due to the presence of the inequality constraints. In this paper, we propose to overcome this difficulty by reformulating the problem as a system of semismooth equations with two level metric projection operators. We then design an inexact smoothing Newton method to solve the resulting semismooth system. At each iteration, we use the BiCGStab iterative solver to obtain an approximate solution to the generated smoothing Newton linear system. Our numerical experiments confirm the high efficiency of the proposed method.

mathematics, applied
CaΣoS: A nonlinear sum-of-squares optimization suite

Torbjørn Cunis,Jan Olucak

2024-10-02

Abstract:We present Ca$\Sigma$oS, the first MATLAB software specifically designed for nonlinear sum-of-squares optimization. A symbolic polynomial algebra system allows to formulate parametrized sum-of-squares optimization problems and facilitates their fast, repeated evaluations. To that extent, we make use of CasADi's symbolic framework and realize concepts of monomial sparsity, linear operators (including duals), and functions between polynomials. Ca$\Sigma$oS currently provides interfaces to the conic solvers SeDuMi, Mosek, and SCS as well as methods to solve quasiconvex optimization problems (via bisection) and nonconvex optimization problems (via sequential convexification). Numerical examples for benchmark problems including region-of-attraction and reachable set estimation for nonlinear dynamic systems demonstrate significant improvements in computation time compared to existing toolboxes. Ca$\Sigma$oS is available open-source at <a class="link-external link-https" href="https://github.com/ifr-acso/casos" rel="external noopener nofollow">this https URL</a>.

Optimization and Control,Systems and Control

UniCalc.LIN: a linear constraint solver for the UniCalc system

Solving Mathematical Programs with Equilibrium Constraints

A Unified Tool for Solving Uni-Parametric Linear Programs, Convex Quadratic Programs, and Linear Complementarity Problems

Structured Regularization In Barrier Nlp For Optimization Models With Dependent Constraints

Master–slave elimination scheme for arbitrary smooth nonlinear multi-point constraints

Design and Implementation of Large-scale Nonlinear Optimization Software UniOptima

On the Least Squares Solutions of a System of Bilinear Equations

A version of the simplex method for solving linear systems of inequalities and linear programming problems

2D Geometric Constraint Solver

Unifying nonlinearly constrained nonconvex optimization

NonlinearSolve.jl: High-Performance and Robust Solvers for Systems of Nonlinear Equations in Julia

UNICON: A UNIform CONstraint Based Graph Layout Framework.

Nonlinear Programming Solvers for Unconstrained and Constrained Optimization Problems: a Benchmark Analysis

Solving Hybrid Assembly Constraint Systems

Least squares solutions of bilinear equations

Automation of Triangle Ruler-and-Compass Constructions Using Constraint Solvers

Towards Automatic Linearization via SMT Solving

Numerical methods of closed-loop multibody systems with singular configurations based on the geometrical structure of constraints

Linnea: Automatic Generation of Efficient Linear Algebra Programs

Calibrating Least Squares Semidefinite Programming with Equality and Inequality Constraints

CaΣoS: A nonlinear sum-of-squares optimization suite