Abstract:Tridiagonal system solver is an important kernel in many scientific and engineering applications. Even though quite a few parallel algorithms and implementations have been addressed in recent years, challenges still remain when solving large-scale tridiagonal system on heterogenous supercomputers. In this paper, a hierarchical algorithm framework SPIKE (pronounced 'SPIKE squared') is proposed to minimize the parallel overhead and to achieve the best utilization of CPU-GPU hybrid systems. In these systems, a layered and adaptive partitioning is presented based on the SPIKE algorithm to effectively control the sequential parts while efficiently exploiting the computation and communication overlapping in heterogeneous computing node. Moreover, the SPIKE algorithm is reformulated to reduce the matrix computations to only 1/3 in our hierarchical algorithm framework. Meanwhile, an improved implementation of the tiled-PCR-pThomas algorithm is employed for the GPU architecture, and the shared memory usage on the GPU can be reduced by 1/3 using careful dependence analysis on solving unit vector tridiagonal systems. Our experiments on Tianhe-1A show ideal weak scalability on up to 128 nodes when solving a tridiagonal system with a size of 1920M in the largest run and good strong scalability (70%) from 32 nodes to 256 nodes when solving a tridiagonal system with a size of 480M. Furthermore, the adaptive task partition across the CPU and GPU can get over 10% performance improvement in the strong scaling test with 256 nodes. In one computing node of Tianhe-1A, our GPU-only code can outperform the CUSPARSE version (non-pivoting tridiagonal solver) by 30%, and our hybrid code is about 6.7 times faster than the Intel SPIKE multi-process version for tridiagonal systems having a size of 3M, 5M, and 15M.

Scalable Hierarchical Parallel Algorithm for the Solution of Super Large-Scale Sparse Linear Equations

A Parallel Simulator for Massive Reservoir Models Utilizing Distributed-Memory Parallel Systems

Large Scale Numerical Simulation Via Parallelization and Reconfigurable Computing Hardware

Hierarchical subspace evolution method for super large parallel computing: A linear solver and an eigensolver as examples

Parallel Computation Of Meshfree Methods For Extremely Large Deformation Analysis

A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

A Class of Parallel Algorithms for Solving Large Sparse Linear Systems on Multiprocessors

A Hierarchical Tridiagonal System Solver for Heterogenous Supercomputers

Parallel Computation Method For Solving Large Scale Equation-Oriented Models

Hierarchical Node Method for Solving Large-Scale Sparse Linear Equations in Parallel

Parallel Algorithm for Explicit Integration Method in Nonlinear Dynamic Structural Analysis

Collective Communication Optimization for Solving Linear Algebraic Equations

Scalable Distributed Least Square Algorithms for Large-Scale Linear Equations Via an Optimization Approach

Parallel optimization and application of unstructured sparse triangular solver on new generation of Sunway architecture

Parallel approach of three-dimensional phase-field model of binary alloy in MPI+OpenMP environment

Massively Parallel Simulation Of Large-Scale Electromagnetic Problems Using One High-Performance Computing Scheme And Domain Decomposition Method

A Scalable Hybrid Algorithm for Solving Partial Differential Equations on a Cluster of CPU/GPU

Parallel Computing of Large Eigenvalue Problems for Engineering Structures

A Parallel Approach for the Generation of Unstructured Meshes with Billions of Elements on Distributed-Memory Supercomputers

Virtual Transmission Method, A New Distributed Algorithm to Solve Sparse Linear Systems

Parallel algorithms and implement of explicit integration method for structural dynamic analysis