Abstract:The generalized Dryja--Smith--Widlund (GDSW) preconditioner is a two-level overlapping Schwarz domain decomposition (DD) preconditioner that couples a classical one-level overlapping Schwarz preconditioner with an energy-minimizing coarse space. When used to accelerate the convergence rate of Krylov subspace iterative methods, the GDSW preconditioner provides robustness and scalability for the solution of sparse linear systems arising from the discretization of a wide range of partial different equations. In this paper, we present FROSch (Fast and Robust Schwarz), a domain decomposition solver package which implements GDSW-type preconditioners for both CPU and GPU clusters. To improve the solver performance on GPUs, we use a novel decomposition to run multiple MPI processes on each GPU, reducing both solver's computational and storage costs and potentially improving the convergence rate. This allowed us to obtain competitive or faster performance using GPUs compared to using CPUs alone. We demonstrate the performance of FROSch on the Summit supercomputer with NVIDIA V100 GPUs, where we used NVIDIA Multi-Process Service (MPS) to implement our decomposition strategy. The solver has a wide variety of algorithmic and implementation choices, which poses both opportunities and challenges for its GPU implementation. We conduct a thorough experimental study with different solver options including the exact or inexact solution of the local overlapping subdomain problems on a GPU. We also discuss the effect of using the iterative variant of the incomplete LU factorization and sparse-triangular solve as the approximate local solver, and using lower precision for computing the whole FROSch preconditioner. Overall, the solve time was reduced by factors of about $2\times$ using GPUs, while the GPU acceleration of the numerical setup time depend on the solver options and the local matrix sizes.

DuMato: An Efficient Warp-Centric Subgraph Enumeration System for GPU

GPU-Accelerated Batch-Dynamic Subgraph Matching

A GPU-based Graph Pattern Mining System.

GAMMA: A Graph Pattern Mining Framework for Large Graphs on GPU.

GraphPar: Efficient Workload-Aware Subgraph Matching System on Multiple GPUs

Graph-Based Substructure Pattern Mining Using CUDA Dynamic Parallelism.

Efficient and Scalable Graph Pattern Mining on GPUs

A GPU Acceleration Framework for Motif and Discord Based Pattern Mining.

Parallel Data Mining on Graphics Processors

Taming irregular EDA applications on GPUs.

Hybrid CPU-GPU Framework for Network Motifs

Multi-GPU acceleration of large-scale density-based topology optimization

Network Motif Discovery: A GPU Approach

An Efficient Data Structure for Dynamic Graph on GPUs

An Evaluation of Massively Parallel Algorithms for DFA Minimization

An Experimental Study of Two-Level Schwarz Domain Decomposition Preconditioners on GPUs

Efficient Maximal Biclique Enumeration on GPUs.

Towards Accelerating Irregular EDA Applications with GPUs.

The Maximum Common Subgraph Problem: A Parallel and Multi-Engine Approach

xDGP: A Dynamic Graph Processing System with Adaptive Partitioning

SGSI – A Scalable GPU-Friendly Subgraph Isomorphism Algorithm