Abstract:Sparse compiler is a promising solution for sparse tensor algebra optimization. In compiler implementation, reduction in sparse-dense hybrid algebra plays a key role in performance. Though GPU provides various reduction semantics that can better utilize the parallel computing and memory bandwidth capacity, the central question is: how to elevate the flexible reduction semantics to sparse compilation theory that assumes serial execution. Specifically, we have to tackle two main challenges: (1) there are wasted parallelism by adopting static synchronization granularity (2) static reduction strategy limits optimization space exploration. We propose Sgap: s egment g roup and a tomic p arallelism to solve these problems. Atomic parallelism captures the flexible reduction semantics to systematically analyze the optimization space of sparse-dense hybrid algebra on GPU. It is a new optimization technique beyond current compiler-based and open-source runtime libraries. Seg-ment group elevates the flexible reduction semantics to suitable levels of abstraction in the sparse compilation theory. It adopts changeable group size and user-defined reduction strategy to solve challenge (1) and (2), respectively. Finally, we use GPU sparse matrix-matrix multiplication (SpMM) on the TACO compiler as a use case to demonstrate the effectiveness of segment group in reduction semantics elevation. We achieve up to 1.2 x speedup over the original TACO's SpMM kernels. We also apply new optimization techniques found by atomic parallelism to an open-source state-of-the-art SpMM library dgSPARSE. We achieve 1.6 x 2.3 x speedup on the algorithm tuned with atomic parallelism.

Accelerating Sparse-Grid Based SSTA Using Graphics Processing Unit

GPU-Accelerated Static Timing Analysis

Accelerating Static Timing Analysis Using CPU-GPU Heterogeneous Parallelism

Heterogeneous Static Timing Analysis with Advanced Delay Calculator

A GPU-Accelerated Framework for Path-Based Timing Analysis

Parallel Transient Stability-Constrained Optimal Power Flow Using GPU as Coprocessor.

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

Implementation and Optimization of GPU-Based Static State Security Analysis in Power Systems

Towards Accelerating Irregular EDA Applications with GPUs.

GPU-Accelerated Sparse LU Factorization for Circuit Simulation with Performance Modeling

GPU-based Static State Security Analysis inźPower Systems

SSSP on GPU Without Atomic Operation.

Sparse LU Factorization for Parallel Circuit Simulation on GPU

A New Sparse Matrix Vector Multiplication GPU Algorithm Designed for Finite Element Problems

A Modified Nested Sparse Grid Based Adaptive Stochastic Collocation Method For Statistical Static Timing Analysis

Taming irregular EDA applications on GPUs.

Fast Schedulability Analysis Using Commodity Graphics Hardware

An Expansion-Aided Synchronous Conservative Time Management Algorithm on GPU.

GPU-accelerated Path-based Timing Analysis.

A Heterogeneous Parallel Computing Approach Optimizing SpTTM on CPU-GPU Via GCN

Program Optimization of Stencil Based Application on the GPU-Accelerated System