Hypergraph partitions

Alexander Mishchenko,Vladimir Manuilov,Chao You,Han Yang

DOI: https://doi.org/10.48550/arXiv.1909.08307

2019-09-18

Abstract:We suggest a reduction of the combinatorial problem of hypergraph partitioning to a continuous optimization problem.

Data Structures and Algorithms,Optimization and Control

What problem does this paper attempt to address?

High-Quality Hypergraph Partitioning

Sebastian Schlag,Tobias Heuer,Lars Gottesbüren,Yaroslav Akhremtsev,Christian Schulz,Peter Sanders

DOI: https://doi.org/10.1145/3529090

2022-04-21

ACM Journal of Experimental Algorithmics

Abstract:Hypergraphs are a generalization of graphs where edges (aka nets ) are allowed to connect more than two vertices. They have a similarly wide range of applications as graphs. This paper considers the fundamental and intensively studied problem of balanced hypergraph partitioning , which asks for partitioning the vertices into k disjoint blocks of bounded size while minimizing an objective function over the hyperedges. Here, we consider the two most commonly used objectives: the cut-net metric and the connectivity metric . We describe our open source hypergraph partitioner KaHyPar which is based on the successful multi-level approach – driving it to the extreme of using one level for (almost) every vertex. Using carefully designed data structures and dynamic update techniques, this approach turns out to have a very good time–quality tradeoff. We present two preprocessing techniques – pin sparsification using locality sensitive hashing and community detection based on the Louvain algorithm . The community structure is used to guide the coarsening process that incrementally contracts vertices. Portfolio-based partitioning of the contracted hypergraph then already achieves a good initial solution. While reversing the contraction process, a combination of several refinement techniques achieves a good final partitioning. In particular, we support a highly-localized local search that can directly produce a k -way partitioning and complement this with flow-based techniques that take a more global view. Optionally, a memetic algorithm evolves a pool of solution candidates to an overall good solution. We evaluate KaHyPar for a large set of instances from a wide range of application domains. With respect to quality, KaHyPar outperforms all previously considered systems that can handle large hypergraphs such as hMETIS, PaToH, Mondriaan, or Zoltan. Somewhat surprisingly, to some extend, this even extends to graph partitioners such as KaHIP when considering the special case of graphs. KaHyPar is also faster than most of these systems except for PaToH which represents a different speed–quality tradeoff.
Optimizing Graph Partition by Optimal Vertex-Cut: A Holistic Approach.

Wenwen Qu,Weixi Zhang,Ji Cheng,Chaorui Zhang,Wei Han,Bo Bai,Chen Jason Zhang,Liang He,Xiaoling Wang

DOI: https://doi.org/10.1109/icde55515.2023.00083

2023-01-01

Abstract:Graph partitioning is crucial in distributed graph-parallel computing systems, and it is challenging for graph partitioning to optimize the communication cost and load balancing together. Existing state-of-the-art works, such as Powerlyra and TopoX, optimize the load balancing by randomly distributing the edges of high-degree vertices, which inevitably brings a high communication cost that is unbounded. This paper proposes a graph partition model that can minimize communication cost while maximizing load balancing. More specifically, we model the graph partition as the combinatorial design problem. Our proposed model can provide high-quality partition that guarantees that the computing load can be evenly distributed to each worker and minimizes the communication cost with a near-optimal theoretical boundary.Based on the proposed model, we extend the hybrid-cut partitioning algorithm for the power-law graph and propose HCPD, a hybrid-cut partitioning algorithm based on combinatorial design. HCPD uses the proposed model to optimize the load balancing and communication cost simultaneously for high-degree vertices, and assigns the high-degree vertices and their low-degree neighbors to the same workers by label propagation to reduce the overall communication cost. In this way, we partition the low-degree and high-degree vertices holistically and further improve the partition quality, unlike Powerlyra and TopoX, which deal with the two parts independently. Our experiments show that HCPD outperforms Powerlyra on PageRank task by up to 2× faster on real-world power-law graphs with billions of edges.
HyperX: A Scalable Hypergraph Framework

Wenkai Jiang,Jianzhong Qi,Jeffrey Xu Yu,Jin Huang,Rui Zhang

DOI: https://doi.org/10.1109/tkde.2018.2848257

IF: 9.235

2019-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Hypergraphs are generalizations of graphs where the (hyper)edges can connect any number of vertices. They are powerful tools for representing complex and non-pairwise relationships. However, existing graph computation frameworks cannot accommodate hypergraphs without converting them into graphs, because they do not offer APIs that support (hyper)edges directly. This graph conversion may create excessive replicas and result in very large graphs, causing difficulties in workload balancing. A few tools have been developed for hypergraph partitioning, but they are not general-purpose frameworks for hypergraph processing. In this paper, we propose HyperX, a general-purpose distributed hypergraph processing framework built on top of Spark. HyperX is based on the computation paradigm “Pregel”, which is user-friendly and has been widely adopted by popular graph computation frameworks. To help create balanced workloads for distributed hypergraph processing, we further investigate the hypergraph partitioning problem and propose a novel label propagation partitioning (LPP) algorithm. We conduct extensive experiments using both real and synthetic data. The result shows that HyperX achieves an order of magnitude improvement for running hypergraph learning algorithms compared with graph conversion based approaches in terms of running time, network communication costs, and memory consumption. For hypergraph partitioning, LPP outperforms the baseline algorithms significantly in these measures as well.
The feasible region of hypergraphs

Xizhi Liu,Dhruv Mubayi

DOI: https://doi.org/10.1016/j.jctb.2020.12.004

2021-05-01

Abstract:Let <math>F</math> be a family of r-uniform hypergraphs. The feasible region <math>Ω(F)</math> of <math>F</math> is the set of points <math>(x,y)</math> in the unit square such that there exists a sequence of <math>F</math>-free r-uniform hypergraphs whose shadow density approaches x and whose edge density approaches y. The feasible region provides a lot of combinatorial information, for example, the supremum of y over all <math>(x,y)∈Ω(F)</math> is the Turán density <math>π(F)</math>, and <math>Ω(∅)</math> gives the Kruskal-Katona theorem.We undertake a systematic study of <math>Ω(F)</math>, and prove that <math>Ω(F)</math> is completely determined by a left-continuous almost everywhere differentiable function; and moreover, there exists an <math>F</math> for which this function is not continuous. We also extend some old related theorems. For example, we generalize a result of Fisher and Ryan to hypergraphs and extend a classical result of Bollobás by almost completely determining the feasible region for cancellative triple systems.
High-dimensional clustering: a clique-based hypergraph partitioning framework

Tianming Hu,Chuanren Liu,Yong Tang,Jing Sun,Hui Xiong,Sam Yuan Sung

DOI: https://doi.org/10.1007/s10115-012-0609-3

2013-01-01

Abstract:Hypergraph partitioning has been considered as a promising method to address the challenges of high-dimensional clustering. With objects modeled as vertices and the relationship among objects captured by the hyperedges, the goal of graph partitioning is to minimize the edge cut. Therefore, the definition of hyperedges is vital to the clustering performance. While several definitions of hyperedges have been proposed, a systematic understanding of desired characteristics of hyperedges is still missing. To that end, in this paper, we first provide a unified clique perspective of the definition of hyperedges, which serves as a guide to define hyperedges. With this perspective, based on the concepts of shared (reverse) nearest neighbors, we propose two new types of clique hyperedges and analyze their properties regarding purity and size issues. Finally, we present an extensive evaluation using real-world document datasets. The experimental results show that, with shared (reverse) nearest neighbor-based hyperedges, the clustering performance can be improved significantly in terms of various external validation measures without the need for fine tuning of parameters.
Highly Connected Graph Partitioning: Exact Formulation and Solution Methods

Rahul Swamy,Douglas M. King,Sheldon H. Jacobson

2024-06-12

Abstract:Graph partitioning (GP) and vertex connectivity have traditionally been two distinct fields of study. This paper introduces the highly connected graph partitioning (HCGP) problem, which partitions a graph into compact, size balanced, and $Q$-(vertex) connected parts for any $Q\geq 1$. This problem is valuable in applications that seek cohesion and fault-tolerance within their parts, such as community detection in social networks and resiliency-focused partitioning of power networks. Existing research in this fundamental interconnection primarily focuses on providing theoretical existence guarantees of highly connected partitions for a limited set of dense graphs, and do not include canonical GP considerations such as size balance and compactness. This paper's key contribution is providing a general modeling and algorithmic approach for HCGP, inspired by recent work in the political districting problem, a special case of HCGP with $Q=1$. This approach models $Q$-connectivity constraints as mixed integer programs for any $Q\geq 1$ and provides an efficient branch-and-cut method to solve HCGP. When solution time is a priority over optimality, this paper provides a heuristic method specifically designed for HCGP with $Q=2$. A computational analysis evaluates these methods using a test bed of instances from various real-world graphs. In this analysis, the branch-and-cut method finds an optimal solution within one hour in $82.8\%$ of the instances solved. For $Q=2$, small and sparse instances are challenging for the heuristic, whereas large and sparse instances are challenging for the exact method. Furthermore, this study quantifies the computational cost of ensuring higher connectivity using the branch-and-cut approach, compared to a baseline of ensuring $1$-connectivity. Overall, this work serves as an effective tool to partition a graph into resilient and cohesive parts.

Discrete Mathematics,Optimization and Control
Hypergraph Partitioning Satisfying Dual Constraints on Vertex and Edge Weight

Changdao Dong,Qiang Zhou,Yici Cai,Xianlong Hong

DOI: https://doi.org/10.1109/mwscas.2008.4616742

2008-01-01

Abstract:In this paper we present a multilevel hypergraph partitioning algorithm which satisfies not only vertex weight constraint but also edge weight constraint. In our multilevel paradigm, two FM (Fiduccia and Mattheyses, 1988) variants are performed alternately in the refinement stage. The first FM variant aims to symmetrize edge weight of the two partitioning blocks and the other aims to minimize cut size under dual constraints on both edge and vertex weight. Inheritance of edge weights by vertices is considered in the coarsening stage. Experimental results on ISPD-98 show that our algorithm satisfies both 10% and 2% dual constraints, producing solutions, under 10% dual constraints, with much more balanced edge weight than hMetis, MLPart, and FM in terms of imbalance proportion by 837.2%, 1039.1% and 762.9%, and reasonable cut size increment by 29.0%, 28.4% and -42.3%, run time increment by 109.2%, 61.8% and 43.7%, respectively.
Permutation Picture of Graph Combinatorial Optimization Problems

Yimeng Min

2024-10-22

Abstract:This paper proposes a framework that formulates a wide range of graph combinatorial optimization problems using permutation-based representations. These problems include the travelling salesman problem, maximum independent set, maximum cut, and various other related problems. This work potentially opens up new avenues for algorithm design in neural combinatorial optimization, bridging the gap between discrete and continuous optimization techniques.

Artificial Intelligence,Machine Learning
Multilevel Hypergraph Partitioning with Vertex Weights Revisited

Tobias Heuer,Nikolai Maas,Sebastian Schlag

DOI: https://doi.org/10.48550/arXiv.2102.01378

2021-02-02

Abstract:The balanced hypergraph partitioning problem (HGP) is to partition the vertex set of a hypergraph into k disjoint blocks of bounded weight, while minimizing an objective function defined on the hyperedges. Whereas real-world applications often use vertex and edge weights to accurately model the underlying problem, the HGP research community commonly works with unweighted instances. In this paper, we argue that, in the presence of vertex weights, current balance constraint definitions either yield infeasible partitioning problems or allow unnecessarily large imbalances and propose a new definition that overcomes these problems. We show that state-of-the-art hypergraph partitioners often struggle considerably with weighted instances and tight balance constraints (even with our new balance definition). Thus, we present a recursive-bipartitioning technique that is able to reliably compute balanced (and hence feasible) solutions. The proposed method balances the partition by pre-assigning a small subset of the heaviest vertices to the two blocks of each bipartition (using an algorithm originally developed for the job scheduling problem) and optimizes the actual partitioning objective on the remaining vertices. We integrate our algorithm into the multilevel hypergraph partitioner KaHyPar and show that our approach is able to compute balanced partitions of high quality on a diverse set of benchmark instances.

Data Structures and Algorithms
Scalable Hypergraph Visualization

Peter Oliver,Eugene Zhang,Yue Zhang

DOI: https://doi.org/10.1109/TVCG.2023.3326599

Abstract:Hypergraph visualization has many applications in network data analysis. Recently, a polygon-based representation for hypergraphs has been proposed with demonstrated benefits. However, the polygon-based layout often suffers from excessive self-intersections when the input dataset is relatively large. In this paper, we propose a framework in which the hypergraph is iteratively simplified through a set of atomic operations. Then, the layout of the simplest hypergraph is optimized and used as the foundation for a reverse process that brings the simplest hypergraph back to the original one, but with an improved layout. At the core of our approach is the set of atomic simplification operations and an operation priority measure to guide the simplification process. In addition, we introduce necessary definitions and conditions for hypergraph planarity within the polygon representation. We extend our approach to handle simultaneous simplification and layout optimization for both the hypergraph and its dual. We demonstrate the utility of our approach with datasets from a number of real-world applications.
Hypergraphs and Decision Trees (Abstract).

Andrew Chi-Chih Yao

DOI: https://doi.org/10.1007/3-540-62559-3_1

1996-01-01

Abstract:We survey some recent results on a space decomposition problem that has a close relationship to the size of algebraic decision trees. These results are obtained by establishing connections between the decomposition problem and some extremal questions in hypergraphs.
On Reducible Partition of Graphs

Li Xi

2021-01-01

Abstract:An undirected graph H is called a minor of the graph G if H can be formed from G by deleting edges and vertices and by contracting edges. If G does not have a graph H as a minor, then we say that G is H-free. Hadwiger conjecture claim that the chromatic number of G may be closely related to whether it contains Kn+1 minors. To study the color of a Kn+1-free G, we propose a new concept of reducible partition of vertex set VG of G. A reducible partition of a graph G with Kn minors and without Kn+1 minors is defined as a two-tuples {S1 ⊆ VG, S2 ⊆ VG} which satisfy the following condisions: (a) S2 is dominated by S1, (b) the induced graph G [S1] is a forest, (c) the induced graph G [S2] is Kn-free. We will show that the reducible partition always exist and it can be used for study the color of G.
SHyPar: A Spectral Coarsening Approach to Hypergraph Partitioning

Hamed Sajadinia,Ali Aghdaei,Zhuo Feng

2024-10-09

Abstract:State-of-the-art hypergraph partitioners utilize a multilevel paradigm to construct progressively coarser hypergraphs across multiple layers, guiding cut refinements at each level of the hierarchy. Traditionally, these partitioners employ heuristic methods for coarsening and do not consider the structural features of hypergraphs. In this work, we introduce a multilevel spectral framework, SHyPar, for partitioning large-scale hypergraphs by leveraging hyperedge effective resistances and flow-based community detection techniques. Inspired by the latest theoretical spectral clustering frameworks, such as HyperEF and HyperSF, SHyPar aims to decompose large hypergraphs into multiple subgraphs with few inter-partition hyperedges (cut size). A key component of SHyPar is a flow-based local clustering scheme for hypergraph coarsening, which incorporates a max-flow-based algorithm to produce clusters with substantially improved conductance. Additionally, SHyPar utilizes an effective resistance-based rating function for merging nodes that are strongly connected (coupled). Compared with existing state-of-the-art hypergraph partitioning methods, our extensive experimental results on real-world VLSI designs demonstrate that SHyPar can more effectively partition hypergraphs, achieving state-of-the-art solution quality.

Social and Information Networks,Machine Learning
Research on Cellular Automata Model of Hypergraph Partitioning Problem and Its Algorithm

LENG Ming,SUN Ling-yu,BIAN Ji-nian,MA Yu-chun,ZHU Ping

DOI: https://doi.org/10.3969/j.issn.1000-3428.2012.15.007

2012-01-01

Abstract:The Cellular Automata(CA) model for the problem by applying the CAtheory and a min-cut partitioning algorithm based on the model for bisecting weighted hypergraph are proposed.In the model,the vertex of hypergraph can be considered as the cell,the vertices of adjacent hypergraph are denoted by the CA-neighborhoods and each cell’s state represents the partitioning which the corresponded vertex belongs to.Furthermore,the two-dimensional auxiliary array is designed for counting the vertices of each hypergraph in different partitions.The rapid method of calculating the cell’s gain and the cut’s size are proposed to avoid traversing each vertex of hypergraph.Experimental results show that the algorithm not only can find the better partitioning of weighted hypergraph than the move-based method and graph parti-tioning algorithm,but also can reduce the time complexity and the space complexity.
On a specific problem of partition of graph

Peisheng Yu

2023-08-14

Abstract:In this short article, we consider a problem about $2$-partition of the vertices of a graph. If a graph admits such a partition into some 'small' graphs, then the number of edges cross an arbitrary cut of the graph $e(S,S^{c})$ has a nice lower bound.

Combinatorics
Quantum Hamiltonian Descent for Graph Partition

Jinglei Cheng,Ruilin Zhou,Yuhang Gan,Chen Qian,Junyu Liu

2024-11-22

Abstract:We introduce Quantum Hamiltonian Descent as a novel approach to solve the graph partition problem. By reformulating graph partition as a Quadratic Unconstrained Binary Optimization (QUBO) problem, we leverage QHD's quantum-inspired dynamics to identify optimal community structures. Our method implements a multi-level refinement strategy that alternates between QUBO formulation and QHD optimization to iteratively improve partition quality. Experimental results demonstrate that our QHD-based approach achieves superior modularity scores (up to 5.49\%) improvement with reduced computational overhead compared to traditional optimization methods. This work establishes QHD as an effective quantum-inspired framework for tackling graph partition challenges in large-scale networks.

Quantum Physics,Artificial Intelligence,Machine Learning
A Partitionability of Interconnection Networks.

SQ Zheng,K Li,Y Pan,H Shen,GH Young

1997-01-01

Abstract:We introduce the concept of equal chromatic partition of networks. This concept is useful for deriving lower bounds and upper bounds for performance ratios of dynamic tree embedding schemes arise in a wide range of tree-structured parallel computations. We provide necessary and sufficient conditions for the existence of equal chromatic partitions of several classes of interconnection networks which include X-Nets, folded hypercubes, X-trees, n-dimensional tori and k-ary n-cubes. We use the pyramid network as an example to show that some networks do not have equal chromatic partitions, but may have near-equal chromatic partitions.
Perfect colorings of hypergraphs

Anna A. Taranenko

2024-10-24

Abstract:Perfect colorings (equitable partitions) of graphs are extensively studied, while the same concept for hypergraphs attracts much less attention. The aim of this paper is to develop basic notions and properties of perfect colorings for hypergraphs. Firstly, we introduce a multidimensional matrix equation for perfect colorings of hypergraphs and compare this definition with a standard approach based on the incidence graph. Next, we show that the eigenvalues of the parameter matrix of a perfect coloring are eigenvalues of the multidimensional adjacency matrix of a hypergraph. We consider coverings of hypergraphs as a special case of perfect colorings and prove a theorem on the existence of a common covering of two hypergraphs. As an example, we show that a $k$-transversal in a hypergraph corresponds to a perfect coloring and calculate its parameters. At last, we find all perfect $2$-colorings of the Fano's plane hypergraph and compute some eigenvalues of this hypergraph.

Combinatorics
A New Hyper-Graph Partitioning for 3D-FPGA

Li-Ran Hu,Qing-hua Duan,Zhu-jun Qi,Jian Wang,Jin-Mei Lai,Meng Yang

DOI: https://doi.org/10.1109/icsict.2018.8565776

2018-01-01

Abstract:In this paper, we present a new hyper-graph partitioning algorithm (MKHP) for 3D-FPGA circuits. Our scheme which based on multilevel paradigm has three phases. In coarsening phase, we use hyper-edge first coarsening scheme (HFC) to obtain a coarser hyper-graph; In initial partitioning phase, we use multilevel recursive bisection to obtain a high-quality k-way initial partitions; Then in uncoarsening phase, a partitioning of the coarser hyper-graph is successively projected to the next-level finer hyper-graph, and a boundary greedy refinement algorithm is used to reduce the hyper-edge cut. Our experiments show that our multilevel k-way partitioning algorithm produced partitions are 8.9% better than those produced by HMETIS which was the most famous hyper-graph partitioning algorithm.
Hypergraph partitioning for multiple communication cost metrics: Model and methods

Mehmet Deveci,Kamer Kaya,Bora Uçar,Ümit V. Çatalyürek

DOI: https://doi.org/10.1016/j.jpdc.2014.12.002

IF: 4.542

2015-03-01

Journal of Parallel and Distributed Computing

Abstract:We investigate hypergraph partitioning-based methods for efficient parallelization of communicating tasks. A good partitioning method should divide the load among the processors as evenly as possible and minimize the inter-processor communication overhead. The total communication volume is the most popular communication overhead metric which is reduced by the existing state-of-the-art hypergraph partitioners. However, other metrics such as the total number of messages, the maximum amount of data transferred by a processor, or a combination of them are equally, if not more, important. Existing hypergraph-based solutions use a two phase approach to minimize such metrics where in each phase, they minimize a different metric, sometimes at the expense of others. We propose a one-phase approach where all the communication cost metrics can be effectively minimized in a multi-objective setting and reductions can be achieved for all metrics together. For an accurate modeling of the maximum volume and the number of messages sent and received by a processor, we propose the use of directed hypergraphs. The directions on hyperedges necessitate revisiting the standard partitioning heuristics. We do so and propose a multi-objective, multi-level hypergraph partitioner called UMPa. The partitioner takes various prioritized communication metrics into account, and optimizes all of them together in the same phase. Compared to the state-of-the-art methods which only minimize the total communication volume, we show on a large number of problem instances that UMPa produces better partitions in terms of several communication metrics.

computer science, theory & methods

Hypergraph partitions

High-Quality Hypergraph Partitioning

Optimizing Graph Partition by Optimal Vertex-Cut: A Holistic Approach.

HyperX: A Scalable Hypergraph Framework

The feasible region of hypergraphs

High-dimensional clustering: a clique-based hypergraph partitioning framework

Highly Connected Graph Partitioning: Exact Formulation and Solution Methods

Hypergraph Partitioning Satisfying Dual Constraints on Vertex and Edge Weight

Permutation Picture of Graph Combinatorial Optimization Problems

Multilevel Hypergraph Partitioning with Vertex Weights Revisited

Scalable Hypergraph Visualization

Hypergraphs and Decision Trees (Abstract).

On Reducible Partition of Graphs

SHyPar: A Spectral Coarsening Approach to Hypergraph Partitioning

Research on Cellular Automata Model of Hypergraph Partitioning Problem and Its Algorithm

On a specific problem of partition of graph

Quantum Hamiltonian Descent for Graph Partition

A Partitionability of Interconnection Networks.

Perfect colorings of hypergraphs

A New Hyper-Graph Partitioning for 3D-FPGA

Hypergraph partitioning for multiple communication cost metrics: Model and methods