Abstract:Network of workstations, NOW or COW, is attracting increased attention as a variable platform for high performance parallel computation. It has higher ratio of performance to price, and it is also more flexible and more scalable. But NOW has two major characteristics, nondedicated and heterogeneous, which distinguish the NOW system from conventional multi-processor or other multi-computer systems, and make other parallel computational models unsuitable and inaccurate for it. Thus a realistic parallel computational model, called Nondedicated Heterogeneous Barrier LogGP model, NHBL, is presented for NOW and MPP in this paper. NHBL model is based on the LogGP model and is expanded to fit in with NOW's special characteristics. This model is aimed to reflect the influence of different computing power between workstations and the influence of computations occupied by other user's applications on designing and analysis of parallel algorithms on NOW. This model also presents accurate computation and communication cost models. In this paper, we first describe NHBL model and its computation and communication cost models in details, and show the programming style and the method of NHBL model using PSRS algorithm under MPI environment. Then the computation and communication costs of PSRS algorithm are analyzed with NHBL model. At last, PSRS algorithm is implemented on NHPCC-NOW and Dawning-1000 MPP, which located in National High Performance Computing Center at Hefei, and the analysis results are validated by those experiment results. Experimental results show that NHBL model captures the most important features of NOW, and it is practical and correct for NOW and MPP. Furthermore, NHBL model is a realistic computational model since it can work only with a subset of the parameters that is enough to the design and analysis of algorithms on certain platforms. More experiment data on more platforms and more accurate and simple cost models are our future work.

Interfacing Interpreted and Compiled Languages to Support Applications on a Massively Parallel Network of Workstations (MP-NOW)

A Tool for Programming Embarrassingly Task Parallel Applications on CoW and NoW

Workstation Cluster as a Parallel Hardware Environment for High Performance Computing.

A Realistic Parallel Computational Model

Parallelization of Kinetic Theory Simulations

An Execution Environment for Robust Parallel Computing on Volunteer PC Grids.

A Parallel Programming Environment for Networks

Enabling Rapid Development of Parallel Tree Search Applications

Evaluating Portable Parallelization Strategies for Heterogeneous Architectures in High Energy Physics

Toward Interlanguage Parallel Scripting for Distributed-Memory Scientific Computing

Implementing O(N) N-Body Algorithms Efficiently in Data-Parallel Languages.

MPICH-G2: A Grid-Enabled Implementation of the Message Passing Interface

Parallel Computing of SNiPER Based on Intel TBB

Portable Programming Model Exploration for LArTPC Simulation in a Heterogeneous Computing Environment: OpenMP vs. SYCL

Parallelization of Network Dynamics Computations in Heterogeneous Distributed Environment

Molecular Dynamics Simulation On Commodity Shared-Memory Multiprocessor Systems With Lightweight Multithreading

Nimrod/G: An Architecture of a Resource Management and Scheduling System in a Global Computational Grid

NO2: Speeding Up Parallel Processing of Massive Compute-Intensive Tasks

Optimization of Lattice Boltzmann Simulations on Heterogeneous Computers

Parallelization of Bayesian Network Based SNPs Pattern Analysis and Performance Characterization on SMP/HT

A Novel High Performance Computing Platform in Distributed Environment