Abstract:Network of workstations, NOW or COW, is attracting increased attention as a variable platform for high performance parallel computation. It has higher ratio of performance to price, and it is also more flexible and more scalable. But NOW has two major characteristics, nondedicated and heterogeneous, which distinguish the NOW system from conventional multi-processor or other multi-computer systems, and make other parallel computational models unsuitable and inaccurate for it. Thus a realistic parallel computational model, called Nondedicated Heterogeneous Barrier LogGP model, NHBL, is presented for NOW and MPP in this paper. NHBL model is based on the LogGP model and is expanded to fit in with NOW's special characteristics. This model is aimed to reflect the influence of different computing power between workstations and the influence of computations occupied by other user's applications on designing and analysis of parallel algorithms on NOW. This model also presents accurate computation and communication cost models. In this paper, we first describe NHBL model and its computation and communication cost models in details, and show the programming style and the method of NHBL model using PSRS algorithm under MPI environment. Then the computation and communication costs of PSRS algorithm are analyzed with NHBL model. At last, PSRS algorithm is implemented on NHPCC-NOW and Dawning-1000 MPP, which located in National High Performance Computing Center at Hefei, and the analysis results are validated by those experiment results. Experimental results show that NHBL model captures the most important features of NOW, and it is practical and correct for NOW and MPP. Furthermore, NHBL model is a realistic computational model since it can work only with a subset of the parameters that is enough to the design and analysis of algorithms on certain platforms. More experiment data on more platforms and more accurate and simple cost models are our future work.

HLognGP: A Parallel Computation Model for GPU Clusters

AN PARALLEL AND DISTRIBUTED PROGRAMMING SOLUTION BASED ON HETEROGENEOUS GPU CLUSTER

Gpupom: a GPU-based Princeton Ocean Model

High Performance Computing Via a GPU

GPU-HADVPPM4HIP V1.0: using the heterogeneous-compute interface for portability (HIP) to speed up the piecewise parabolic method in the CAMx (v6.10) air quality model on China's domestic GPU-like accelerator

HPH: Hybrid Parallelism on Heterogeneous Clusters for Accelerating Large-scale DNNs Training.

GMH: A Message Passing Toolkit for GPU Clusters

A Performance Model for General-Purpose Computation on GPU

POM.gpu-v1.0: a GPU-based Princeton Ocean Model

Data Partitioning Strategy of GPU Heterogeneous Clusters Based on Learning

Overcoming Limitations of GPGPU-Computing in Scientific Applications

A MapReduce Computing Framework Based on GPU Cluster.

ParaGraph: Weighted Graph Representation for Performance Optimization of HPC Kernels

Study of A Gpu-Based Parallel Computing Method for the Monte Carlo Program

A Realistic Parallel Computational Model

Programming Framework for Node Heterogeneous GPU Cluster

Optimizing the LINPACK Algorithm for Large-Scale PCIe-Based CPU-GPU Heterogeneous Systems

A parallel implementation of nearest neighbor analysis based on GPGPU

A Unified, Hardware-Fitted, Cross-GPU Performance Model

Parallel Data Mining on Graphics Processors

A Flexible Patch-Based Lattice Boltzmann Parallelization Approach for Heterogeneous GPU-CPU Clusters