weberknecht -- a One-Sided Crossing Minimization solver

Johannes Rauch

2024-12-09

Abstract:We describe the implementation of the exact solver weberknecht and the heuristic solver weberknecht_h for the One-Sided Crossing Minimization problem.

Data Structures and Algorithms

What problem does this paper attempt to address?

Arcee: An OCM-Solver

Kimon Boehmer,Lukas Lee George,Fanny Hauser,Jesse Palarus

2024-11-27

Abstract:The 2024 PACE Challenge focused on the One-Sided Crossing Minimization (OCM) problem, which aims to minimize edge crossings in a bipartite graph with a fixed order in one partition and a free order in the other. We describe our OCM solver submission that utilizes various reduction rules for OCM and, for the heuristic track, employs local search approaches as well as techniques to escape local minima. The exact and parameterized solver uses an ILP formulation and branch & bound to solve an equivalent Feedback Arc Set instance.

Data Structures and Algorithms
PACE Solver Description: Exact Solution of the One-sided Crossing Minimization Problem by the MPPEG Team

Michael Jünger,Paul J. Jünger,Petra Mutzel,Gerhard Reinelt

2024-11-30

Abstract:This is a short description of our solver OSCM submitted by our team MPPEG to the PACE 2024 challenge both for the exact track and the parameterized track, available at <a class="link-external link-https" href="https://github.com/pauljngr/PACE2024" rel="external noopener nofollow">this https URL</a> and <a class="link-external link-https" href="https://doi.org/10.5281/zenodo.11546972" rel="external noopener nofollow">this https URL</a>.

Data Structures and Algorithms
Evolutionary Algorithms for One-Sided Bipartite Crossing Minimisation

Jakob Baumann,Ignaz Rutter,Dirk Sudholt

2024-09-05

Abstract:Evolutionary algorithms (EAs) are universal solvers inspired by principles of natural evolution. In many applications, EAs produce astonishingly good solutions. As they are able to deal with complex optimisation problems, they show great promise for hard problems encountered in the field of graph <a class="link-external link-http" href="http://drawing.To" rel="external noopener nofollow">this http URL</a> complement recent theoretical advances in the analysis of EAs on graph drawing, we contribute a fundamental empirical study. We consider the so-called \textsc{One-Sided Bipartite Crossing Minimisation (OBCM)}: given two layers of a bipartite graph and a fixed horizontal order of vertices on the first layer, the task is to order the vertices on the second layer to minimise the number of edge crossings. We empirically analyse the performance of simple EAs for OBCM and compare different mutation operators on the underlying permutation ordering problem: exchanging two elements (\textit{exchange}), swapping adjacent elements (\textit{swap}) and jumping an element to a new position (\textit{jump}). EAs using jumps easily outperform all deterministic algorithms in terms of solution quality after a reasonable number of generations. We also design variations of the best-performing EAs to reduce the execution time for each generation. The improved EAs can obtain the same solution quality as before and run up to 100 times faster.

Neural and Evolutionary Computing
A structured modified Newton approach for solving systems of nonlinear equations arising in interior-point methods for quadratic programming

David Ek,Anders Forsgren

DOI: https://doi.org/10.1007/s10589-023-00486-z

2023-05-03

Abstract:The focus in this work is on interior-point methods for inequality-constrained quadratic programs, and particularly on the system of nonlinear equations to be solved for each value of the barrier parameter. Newton iterations give high quality solutions, but we are interested in modified Newton systems that are computationally less expensive at the expense of lower quality solutions. We propose a structured modified Newton approach where each modified Jacobian is composed of a previous Jacobian, plus one low-rank update matrix per succeeding iteration. Each update matrix is, for a given rank, chosen such that the distance to the Jacobian at the current iterate is minimized, in both 2-norm and Frobenius norm. The approach is structured in the sense that it preserves the nonzero pattern of the Jacobian. The choice of update matrix is supported by results in an ideal theoretical setting. We also produce numerical results with a basic interior-point implementation to investigate the practical performance within and beyond the theoretical framework. In order to improve performance beyond the theoretical framework, we also motivate and construct two heuristics to be added to the method.

Optimization and Control
A Parallel Method With Hybrid Algorithms For Mixed Integer Nonlinear Programming

Kai Zhou,Wei Wan,Xi Chen,Zhijiang Shao,Lorenz T. Biegler

DOI: https://doi.org/10.1016/B978-0-444-63234-0.50046-4

2013-01-01

Abstract:This study aims at improving the solution efficiency of Mixed Integer Nonlinear Programming (MINLP) through parallelism. Unlike most conventional parallel implementations of MINLP solvers, which utilize multi-threads to share the burden in the serial mode, the proposed method combines hybrid algorithms running on different threads. Two types of algorithms are designed in a parallel structure. One is the Quesada and Grossman's LP/NLP based branch and bound algorithm (QG); the other is Tabu Search (TS). The proposed method attempts to minimize the search space through continuous communication and exchange of intermediate results from each thread. Three kinds of information are exchanged between the two threads. First, the best solution in TS, if feasible, serves as a valid upper bound for QG. Second, new approximations which can further tighten the lower bound of QG can be generated at nodes provided by the TS. Third, strong branching in QG may fix some integer variables, which can help reduce the search space of TS. Both threads can thus benefit from the exchanged information in the hybrid method. Numerical results show that solution time can be greatly reduced for the tested MINLP. In addition, complexity analysis of the parallel approach suggests that the proposed method has the potential for superlinear speedup.
23 European Symposium on Computer Aided Process Engineering: A Parallel Method with Hybrid Algorithms for Mixed Integer Nonlinear Programming

Kai Zhou,Wei Wan,Xi Chen,Zhijiang Shao,Lorenz T Biegler

2013-01-01

Abstract:This study aims at improving the solution efficiency of Mixed Integer Nonlinear Programming (MINLP) through parallelism. Unlike most conventional parallel implementations of MINLP solvers, which utilize multi-threads to share the burden in the serial mode, the proposed method combines hybrid algorithms running on different threads. Two types of algorithms are designed in a parallel structure. One is the Quesada and Grossman's LP/NLP based branch and bound algorithm (QG); the other is Tabu Search (TS). The proposed method attempts to minimize the search space through continuous communication and exchange of intermediate results from each thread. Three kinds of information are exchanged between the two threads. First, the best solution in TS, if feasible, serves as a valid upper bound for QG. Second, new approximations which can further tighten the lower bound of QG can be generated at nodes provided by the TS. Third, strong branching in QG may fix some integer variables, which can help reduce the search space of TS. Both threads can thus benefit from the exchanged information in the hybrid method. Numerical results show that solution time can be greatly reduced for the tested MINLP. In addition, complexity analysis of the parallel approach suggests that the proposed method has the potential for superlinear speedup.
GPU-based Parallel Solver Via the Kantorovich Theorem for the Nonlinear Bernstein Polynomial Systems.

Feifei Wei,Jieqing Feng,Hongwei Lin

DOI: https://doi.org/10.1016/j.camwa.2011.05.058

IF: 3.218

2011-01-01

Computers & Mathematics with Applications

Abstract:This paper proposes a parallel solver for the nonlinear systems in Bernstein form based on subdivision and the Newton–Raphson method, where the Kantorovich theorem is employed to identify the existence of a unique root and guarantee the convergence of the Newton–Raphson iterations. Since the Kantorovich theorem accommodates a singular Jacobian at the root, the proposed algorithm performs well in a multiple root case. Moreover, the solver is designed and implemented in parallel on Graphics Processing Unit(GPU) with SIMD architecture; thus, efficiency for solving a large number of systems is improved greatly, an observation validated by our experimental results.
New Optimized Robin--Robin Domain Decomposition Methods Using Krylov Solvers for the Stokes--Darcy System

Yingzhi Liu,Yassine Boubendir,Xiaoming He,Yinnian He

DOI: https://doi.org/10.1137/21m1417223

IF: 2.968

2022-01-01

SIAM Journal on Scientific Computing

Abstract:In this paper, we are interested in the design of optimized Schwarz domain decomposition algorithms to accelerate the Krylov type solution for the Stokes-Darcy system. We use particular solutions of this system on a circular geometry to analyze the iteration operator mode by mode. We introduce a new optimization strategy of the so-called Robin parameters based on a specific linear relation between these parameters, using the min-max and the expectation minimization approaches. Moreover, we use a Krylov solver to deal with the iteration operator and accelerate this new optimized domain decomposition algorithm. Several numerical experiments are provided to validate the effectiveness of this new method.
Evaluating and extending speedup techniques for optimal crossing minimization in layered graph drawings

Connor Wilson,Eduardo Puerta,Tarik Crnovrsanin,Sara Di Bartolomeo,Cody Dunne

DOI: https://doi.org/10.1109/TVCG.2024.3456349

2024-09-11

Abstract:A layered graph is an important category of graph in which every node is assigned to a layer, and layers are drawn as parallel or radial lines. They are commonly used to display temporal data or hierarchical graphs. Previous research has demonstrated that minimizing edge crossings is the most important criterion to consider when looking to improve the readability of such graphs. While heuristic approaches exist for crossing minimization, we are interested in optimal approaches to the problem that prioritize human readability over computational scalability. We aim to improve the usefulness and applicability of such optimal methods by understanding and improving their scalability to larger graphs. This paper categorizes and evaluates the state-of-the-art linear programming formulations for exact crossing minimization and describes nine new and existing techniques that could plausibly accelerate the optimization algorithm. Through a computational evaluation, we explore each technique's effect on calculation time and how the techniques assist or inhibit one another, allowing researchers and practitioners to adapt them to the characteristics of their graphs. Our best-performing techniques yielded a median improvement of 2.5-17× depending on the solver used, giving us the capability to create optimal layouts faster and for larger graphs. We provide an open-source implementation of our methodology in Python, where users can pick which combination of techniques to enable according to their use case. A free copy of this paper and all supplemental materials, datasets used, and source code are available at https://osf.io/5vq79.
Non-overlapping Schwarz methods in time for parabolic optimal control problems

Martin Jakob Gander,Liu-Di Lu

2024-08-23

Abstract:We present here the classical Schwarz method with a time domain decomposition applied to unconstrained parabolic optimal control problems. Unlike Dirichlet-Neumann and Neumann-Neumann algorithms, we find different properties based on the forward-backward structure of the optimality system. Variants can be found using only Dirichlet and Neumann transmission conditions. Some of these variants are only good smoothers, while others could lead to efficient solvers.

Numerical Analysis,Optimization and Control
SGN: Sparse Gauss-Newton for Accelerated Sensitivity Analysis

Jonas Zehnder,Stelian Coros,Bernhard Thomaszewski

DOI: https://doi.org/10.1145/3470005

2021-07-09

Abstract:We present a sparse Gauss-Newton solver for accelerated sensitivity analysis with applications to a wide range of equilibrium-constrained optimization problems. Dense Gauss-Newton solvers have shown promising convergence rates for inverse problems, but the cost of assembling and factorizing the associated matrices has so far been a major stumbling block. In this work, we show how the dense Gauss-Newton Hessian can be transformed into an equivalent sparse matrix that can be assembled and factorized much more efficiently. This leads to drastically reduced computation times for many inverse problems, which we demonstrate on a diverse set of examples. We furthermore show links between sensitivity analysis and nonlinear programming approaches based on Lagrange multipliers and prove equivalence under specific assumptions that apply for our problem setting.

Optimization and Control,Numerical Analysis
Kaczmarz Algorithm with Soft Constraints for User Interface Layout

Noreen Jamil,Deanna Needell,Johannes Müller,Christof Lutteroth,Gerald Weber,Johannes Muller

DOI: https://doi.org/10.1109/ictai.2013.125

2013-11-01

Abstract:The Kaczmarz method is an iterative method for solving large systems of equations that projects iterates orthogonally onto the solution space of each equation. In contrast to direct methods such as Gaussian elimination or QR-factorization, this algorithm is efficient for problems with sparse matrices, as they appear in constraint-based user interface (UI) layout specifications. However, the Kaczmarz method as described in the literature has its limitations: it considers only equality constraints and does not support soft constraints, which makes it inapplicable to the UI layout problem. In this paper we extend the Kaczmarz method for solving specifications containing soft constraints, using the prioritized IIS detection algorithm. Furthermore, the performance and convergence of the proposed algorithms are evaluated empirically using randomly generated UI layout specifications of various sizes. The results show that these methods offer improvements in performance over standard methods like Matlab's LINPROG, a well-known efficient linear programming solver.
Crossing Minimization within Graph Embeddings

Amina Shabbeer,Cagri Ozcaglar,Kristin P. Bennett

DOI: https://doi.org/10.48550/arXiv.1210.2041

2012-10-07

Abstract:We propose a novel optimization-based approach to embedding heterogeneous high-dimensional data characterized by a graph. The goal is to create a two-dimensional visualization of the graph structure such that edge-crossings are minimized while preserving proximity relations between nodes. This paper provides a fundamentally new approach for addressing the crossing minimization criteria that exploits Farkas' Lemma to re-express the condition for no edge-crossings as a system of nonlinear inequality constraints. The approach has an intuitive geometric interpretation closely related to support vector machine classification. While the crossing minimization formulation can be utilized in conjunction with any optimization-based embedding objective, here we demonstrate the approach on multidimensional scaling by modifying the stress majorization algorithm to include penalties for edge crossings. The proposed method is used to (1) solve a visualization problem in tuberculosis molecular epidemiology and (2) generate embeddings for a suite of randomly generated graphs designed to challenge the algorithm. Experimental results demonstrate the efficacy of the approach. The proposed edge-crossing constraints and penalty algorithm can be readily adapted to other supervised and unsupervised optimization-based embedding or dimensionality reduction methods. The constraints can be generalized to remove overlaps between any graph components represented as convex polyhedrons including node-edge and node-node intersections.

Optimization and Control
A Penalty-Based Guardrail Algorithm for Non-Decreasing Optimization with Inequality Constraints

Ksenija Stepanovic,Wendelin Böhmer,Mathijs de Weerdt

2024-05-03

Abstract:Traditional mathematical programming solvers require long computational times to solve constrained minimization problems of complex and large-scale physical systems. Therefore, these problems are often transformed into unconstrained ones, and solved with computationally efficient optimization approaches based on first-order information, such as the gradient descent method. However, for unconstrained problems, balancing the minimization of the objective function with the reduction of constraint violations is challenging. We consider the class of time-dependent minimization problems with increasing (possibly) nonlinear and non-convex objective function and non-decreasing (possibly) nonlinear and non-convex inequality constraints. To efficiently solve them, we propose a penalty-based guardrail algorithm (PGA). This algorithm adapts a standard penalty-based method by dynamically updating the right-hand side of the constraints with a guardrail variable which adds a margin to prevent violations. We evaluate PGA on two novel application domains: a simplified model of a district heating system and an optimization model derived from learned deep neural networks. Our method significantly outperforms mathematical programming solvers and the standard penalty-based method, and achieves better performance and faster convergence than a state-of-the-art algorithm (IPDD) within a specified time limit.

Optimization and Control,Artificial Intelligence
Routing Arena: A Benchmark Suite for Neural Routing Solvers

Daniela Thyssens,Tim Dernedde,Jonas K. Falkner,Lars Schmidt-Thieme

2023-10-06

Abstract:Neural Combinatorial Optimization has been researched actively in the last eight years. Even though many of the proposed Machine Learning based approaches are compared on the same datasets, the evaluation protocol exhibits essential flaws and the selection of baselines often neglects State-of-the-Art Operations Research approaches. To improve on both of these shortcomings, we propose the Routing Arena, a benchmark suite for Routing Problems that provides a seamless integration of consistent evaluation and the provision of baselines and benchmarks prevalent in the Machine Learning- and Operations Research field. The proposed evaluation protocol considers the two most important evaluation cases for different applications: First, the solution quality for an a priori fixed time budget and secondly the anytime performance of the respective methods. By setting the solution trajectory in perspective to a Best Known Solution and a Base Solver's solutions trajectory, we furthermore propose the Weighted Relative Average Performance (WRAP), a novel evaluation metric that quantifies the often claimed runtime efficiency of Neural Routing Solvers. A comprehensive first experimental evaluation demonstrates that the most recent Operations Research solvers generate state-of-the-art results in terms of solution quality and runtime efficiency when it comes to the vehicle routing problem. Nevertheless, some findings highlight the advantages of neural approaches and motivate a shift in how neural solvers should be conceptualized.

Machine Learning
A simple, efficient and versatile objective space algorithm for multiobjective integer programming

Kerstin Dächert,Tino Fleuren,Kathrin Klamroth

DOI: https://doi.org/10.1007/s00186-023-00841-0

2024-03-23

Mathematical Methods of Operations Research

Abstract:In the last years a multitude of algorithms have been proposed to solve multiobjective integer programming problems. However, only few authors offer open-source implementations. On the other hand, new methods are typically compared to code that is publicly available, even if this code is known to be outperformed. In this paper, we aim to overcome this problem by proposing a new state-of-the-art algorithm with an open-source implementation in C++ . The underlying method falls into the class of objective space methods, i.e., it decomposes the overall problem into a series of scalarized subproblems that can be solved with efficient single-objective IP-solvers. It keeps the number of required subproblems small by avoiding redundancies, and it can be combined with different scalarizations that all lead to comparably simple subproblems. Our algorithm bases on previous results but combines them in a new way. Numerical experiments with up to ten objectives validate that the method is efficient and that it scales well to higher dimensional problems.

mathematics, applied,operations research & management science
A Massively Parallel Interior-Point-Method for Arrowhead Linear Programs

Nils-Christian Kempke,Daniel Rehfeldt,Thorsten Koch

2024-12-11

Abstract:In practice, non-specialized interior point algorithms often cannot utilize the massively parallel compute resources offered by modern many- and multi-core compute platforms. However, efficient distributed solution techniques are required, especially for large-scale linear programs. This article describes a new decomposition technique for systems of linear equations implemented in the parallel interior-point solver PIPS-IPM++. The algorithm exploits a matrix structure commonly found in optimization problems: a doubly-bordered block-diagonal or arrowhead structure. This structure is preserved in the linear KKT systems solved during each iteration of the interior-point method. We present a hierarchical Schur complement decomposition that distributes and solves the linear optimization problem; it is designed for high-performance architectures and scales well with the availability of additional computing resources. The decomposition approach uses the border constraints' locality to decouple the factorization process. Our approach is motivated by large-scale unit commitment problems. We demonstrate the performance of our method on a set of mid-to large-scale instances, some of which have more than 10^9 nonzeros in their constraint matrix.

Optimization and Control
Paved with good intentions: Analysis of a randomized block Kaczmarz method

Deanna Needell,Joel A. Tropp

DOI: https://doi.org/10.1016/j.laa.2012.12.022

IF: 1.307

2014-01-01

Linear Algebra and its Applications

Abstract:The block Kaczmarz method is an iterative scheme for solving overdetermined least-squares problems. At each step, the algorithm projects the current iterate onto the solution space of a subset of the constraints. This paper describes a block Kaczmarz algorithm that uses a randomized control scheme to choose the subset at each step. This algorithm is the first block Kaczmarz method with an (expected) linear rate of convergence that can be expressed in terms of the geometric properties of the matrix and its submatrices. The analysis reveals that the algorithm is most effective when it is given a good row paving of the matrix, a partition of the rows into well-conditioned blocks. The operator theory literature provides detailed information about the existence and construction of good row pavings. Together, these results yield an efficient block Kaczmarz scheme that applies to many overdetermined least-squares problem.

mathematics, applied
Design and implementation of a modular interior-point solver for linear optimization

Miguel F. Anjos,Andrea Lodi,Mathieu Tanneau

DOI: https://doi.org/10.1007/s12532-020-00200-8

2020-06-24

Abstract:This paper introduces the algorithmic design and implementation of Tulip, an open-source interior-point solver for linear optimization. It implements a regularized homogeneous interior-point algorithm with multiple centrality corrections, and therefore handles unbounded and infeasible problems. The solver is written in Julia, thus allowing for a flexible and efficient implementation: Tulip's algorithmic framework is fully disentangled from linear algebra implementations and from a model's arithmetic. In particular, this allows to seamlessly integrate specialized routines for structured problems. Extensive computational results are reported. We find that Tulip is competitive with open-source interior-point solvers on the H. Mittelmann's benchmark of barrier linear programming solvers. Furthermore, we design specialized linear algebra routines for structured master problems in the context of Dantzig-Wolfe decomposition. These routines yield a tenfold speedup on large and dense instances that arise in power systems operation and two-stage stochastic programming, thereby outperforming state-of-the-art commercial interior point method solvers. Finally, we illustrate Tulip's ability to use different levels of arithmetic precision by solving problems in extended precision.

Optimization and Control
A Unified Tool for Solving Uni-Parametric Linear Programs, Convex Quadratic Programs, and Linear Complementarity Problems

Nathan Adelgren

DOI: https://doi.org/10.48550/arXiv.2203.13135

2022-03-24

Optimization and Control

Abstract:We introduce a new technique for solving uni-parametric versions of linear programs, convex quadratic programs, and linear complementarity problems in which a single parameter is permitted to be present in any of the input data. We demonstrate the use of our method on a small, motivating example and present the results of a small number of computational tests demonstrating its utility for larger scale problems.

weberknecht -- a One-Sided Crossing Minimization solver

Arcee: An OCM-Solver

PACE Solver Description: Exact Solution of the One-sided Crossing Minimization Problem by the MPPEG Team

Evolutionary Algorithms for One-Sided Bipartite Crossing Minimisation

A structured modified Newton approach for solving systems of nonlinear equations arising in interior-point methods for quadratic programming

A Parallel Method With Hybrid Algorithms For Mixed Integer Nonlinear Programming

23 European Symposium on Computer Aided Process Engineering: A Parallel Method with Hybrid Algorithms for Mixed Integer Nonlinear Programming

GPU-based Parallel Solver Via the Kantorovich Theorem for the Nonlinear Bernstein Polynomial Systems.

New Optimized Robin--Robin Domain Decomposition Methods Using Krylov Solvers for the Stokes--Darcy System

Evaluating and extending speedup techniques for optimal crossing minimization in layered graph drawings

Non-overlapping Schwarz methods in time for parabolic optimal control problems

SGN: Sparse Gauss-Newton for Accelerated Sensitivity Analysis

Kaczmarz Algorithm with Soft Constraints for User Interface Layout

Crossing Minimization within Graph Embeddings

A Penalty-Based Guardrail Algorithm for Non-Decreasing Optimization with Inequality Constraints

Routing Arena: A Benchmark Suite for Neural Routing Solvers

A simple, efficient and versatile objective space algorithm for multiobjective integer programming

A Massively Parallel Interior-Point-Method for Arrowhead Linear Programs

Paved with good intentions: Analysis of a randomized block Kaczmarz method

Design and implementation of a modular interior-point solver for linear optimization

A Unified Tool for Solving Uni-Parametric Linear Programs, Convex Quadratic Programs, and Linear Complementarity Problems