Abstract:In high performance computing environments, we observe an ongoing increase in the available numbers of cores. This development calls for re-emphasizing performance (scalability) analysis and speedup laws as suggested in the literature (e.g., Amdahl's law and Gustafson's law), with a focus on asymptotic performance. Understanding speedup and efficiency issues of algorithmic parallelism is useful for several purposes, including the optimization of system operations, temporal predictions on the execution of a program, and the analysis of asymptotic properties and the determination of speedup bounds. However, the literature is fragmented and shows a large diversity and heterogeneity of speedup models and laws. These phenomena make it challenging to obtain an overview of the models and their relationships, to identify the determinants of performance in a given algorithmic and computational context, and, finally, to determine the applicability of performance models and laws to a particular parallel computing setting. In this work, we provide a generic speedup (and thus also efficiency) model for homogeneous computing environments. Our approach generalizes many prominent models suggested in the literature and allows showing that they can be considered special cases of a unifying approach. The genericity of the unifying speedup model is achieved through parameterization. Considering combinations of parameter ranges, we identify six different asymptotic speedup cases and eight different asymptotic efficiency cases. Jointly applying these speedup and efficiency cases, we derive eleven scalability cases, from which we build a scalability typology. Researchers can draw upon our typology to classify their speedup model and to determine the asymptotic behavior when the number of parallel processing units increases. In addition, our results may be used to address various extensions of our setting.

Optimal-Processor-Set Speedup Of Smp Cluster

How to Measure Scalability of SMP Cluster

On-Line Scheduling of Parallel Jobs in Heterogeneous Multiple Clusters

Online Scheduling on a CPU-GPU Cluster

Communication Optimization for SMP Clusters

Parallel Multiple Sequences Alignment in SMP Cluster

Approaches to performance improvement and experiments on a cluster system THNPSC-1

Task Scheduling of Parallel Programs to Optimize Communications for Cluster of SMPs

Hybrid Parallel Bidirectional Sieve based on SMP Cluster

A Prediction Model For Parallel Back Propagation Neural Network On Smp-Cluster

An Extended Openmp Targeting On The Hybrid Architecture Of Smp-Cluster

A Systemic Strategy for Tuning Intra-node Collective Communication on Multicore Systems

Design and implementation of self-adaptable parallel algorithms for scientific computing on highly heterogeneous HPC platforms

Characterizing the Scalability of Decision-Support Workloads on Clusters and SMP Systems.

Automatic Tuning of Sparse Matrix-Vector Multiplication on Multicore Clusters.

MPIPP: an automatic profile-guided parallel process placement toolset for SMP clusters and multiclusters.

Parallel Design and Optimization of Galaxy Group Finding Algorithm on Comparation of SGI and Distributed-memory Cluster

Speedup and efficiency of computational parallelization: A unifying approach and asymptotic analysis

Load Balancing and Speed Scaling Interaction in Processor-Sharing Systems with Exponential Power Functions.

Characterizing the Performance of Node-Aware Strategies for Irregular Point-to-Point Communication on Heterogeneous Architectures