Abstract:Here, we test the performance and scalability of fully-asynchronous, best-effort communication on existing, commercially-available HPC hardware. A first set of experiments tested whether best-effort communication strategies can benefit performance compared to the traditional perfect communication model. At high CPU counts, best-effort communication improved both the number of computational steps executed per unit time and the solution quality achieved within a fixed-duration run window. Under the best-effort model, characterizing the distribution of quality of service across processing components and over time is critical to understanding the actual computation being performed. Additionally, a complete picture of scalability under the best-effort model requires analysis of how such quality of service fares at scale. To answer these questions, we designed and measured a suite of quality of service metrics: simulation update period, message latency, message delivery failure rate, and message delivery coagulation. Under a lower communication-intensivity benchmark parameterization, we found that median values for all quality of service metrics were stable when scaling from 64 to 256 process. Under maximal communication intensivity, we found only minor -- and, in most cases, nil -- degradation in median quality of service. In an additional set of experiments, we tested the effect of an apparently faulty compute node on performance and quality of service. Despite extreme quality of service degradation among that node and its clique, median performance and quality of service remained stable.

PC Cluster Machine Equipped with Low-Latency Communication Software

Fmp: A High Performance Communication Protocol For Pc Clusters Based On Myrinet

A New Fast Message Passing Communication System for Multiprocessor Workstation Clusters

Designing a High Performance Parallel Personal Cluster

Experience with the design of a communication protocol for PC clusters

Fast message passing for high performance computation in workstation clusters

Fast message passing communication for workstation clusters

Fast Message Passing for High Performance Computation inWorkstation Clusters

Design and performance optimization of a popular high performance computing system KD-90

High-Performance PVM Based on Fast Message Passing

LINUX CLUSTER BASED POWER SYSTEM PARALLEL SIMULATION SYSTEM

An Efficient Shared Memory Based Virtual Communication System for Embedded SMP Cluster

Design and Implementation of High Performance Communication Library on Cluster

Understanding Data Movement in Tightly Coupled Heterogeneous Systems: A Case Study with the Grace Hopper Superchip

Optimization of Computation-Intensive Applications in cc-NUMA Architecture

Interfacing Interpreted and Compiled Languages to Support Applications on a Massively Parallel Network of Workstations (MP-NOW)

Dynamic Load-Balancing and High Performance Communication in Jcluster

Best-Effort Communication Improves Performance and Scales Robustly on Conventional Hardware

Heterogeneous Cluster Application Communication Optimization and Computer Big Data Management

Optimization of PVM Based on a User-level Communication Protocol

Design, Construction, and Use of a Single Board Computer Beowulf Cluster: Application of the Small-Footprint, Low-Cost, InSignal 5420 Octa Board