Abstract:This paper proposes a new task assignment scheme for sparse LDL T factorization on a hybrid GPU-CPU platform, and correspondingly an efficient supernodal algorithm, GPU Node and CPU Pipelining ( GNCP ). GNCP assigns a large number of weakly coupled tasks to GPU and CPU respectively so that GPU and CPU can execute different factorization tasks concurrently without explicit synchronization, which has not been achieved by previous researches. More precisely, based on the number of threads of CPU, the global memory of GPU as well the size of the matrix, we introduce the concept of the truncation level in the partition tree built by the multi-level graph partitioning. The sum of FLOP associated with decoupled nodes in the truncation level accounts for about 65% of the whole computations in tested numerical examples. GNCP assigns the factorization tasks of each node in the truncation level to GPU. The data of each node in the truncation level are copied to the global memory of GPU and factorized entirely and independently by GPU one-by-one. Once factorization of any node in the truncation level has been completed, the cross-factorizations of this node to its ancestors and the following related operations are decoupled from other GPU tasks. These tasks are assigned to CPU threads with a reentrant pipelining strategy, accounting for about 35% of the whole calculations. Using this novel design, CPU and GPU are working concurrently and a large part of factorization is performed in overlapped time. Numerical tests for matrices from SuiteSparse matrix collection show higher performance than the well-known hybrid GPU-CPU solver CHOLMOD.

Novel GPU Data Partitioning Method to Overlap Communication and Computation

A parallel computing method for irregular work

Understanding Data Partition for Applications on CPU-GPU Integrated Processors.

Data Partitioning Strategy of GPU Heterogeneous Clusters Based on Learning

A CPU-GPGPU Scheduler Based on Data Transmission Bandwidth of Workload

Locality-aware Thread Block Design in Single and Multi-GPU Graph Processing

Mesh Segmentation for Parallel Decompression on GPU.

Connectivity-Based Segmentation for GPU-Accelerated Mesh Decompression

A Parallel Strategy to Accelerate Neighborhood Operation for Raster Data Coordinating CPU and GPU

Software Pipeline–Based Partitioning Method with Trade-Off Between Workload Balance and Communication Optimization

Parallel Transient Stability-Constrained Optimal Power Flow Using GPU as Coprocessor.

A Virtual Multi-Channel GPU Fair Scheduling Method for Virtual Machines.

A New Hybrid GPU-CPU Sparse LDLT Factorization Algorithm with GPU and CPU Factorizing Concurrently

A Self-Adaptive Workload Balancing Algorithm on Gpu Clusters

Task Partition Comparison between Multi-core System and GPU

Efficient GPU Spatial-Temporal Multitasking

GPU Memory Optimization Through Program Restructuring Methods

A New Hybrid GPU-CPU Sparse LDL T Factorization Algorithm with GPU and CPU Factorizing Concurrently

Optimization of GPU-Based Main-Memory Hash Join

SPGPU: Spatially Programmed GPU

Exploiting Parallelism in the Simulation of General Purpose Graphics Processing Unit Program