Abstract:Offload of MPI collectives to network devices, e.g., NICs and switches, is being implemented as an effective mechanism to improve application performance by reducing inter- and intra-node communication and bypassing MPI software layers. Given the rich deployment of accelerators and programmable NICs/switches in data centers, we posit that there is an opportunity to further improve performance by extending this idea (of in-network collective processing) to a new class of more complex collectives. The most basic type of complex collective is the fusion of existing collectives. In previous work we have demonstrated the efficacy of this additional hardware and software support and shown that it can substantially improve the performance of certain applications. In this work we extend this approach. We seek to characterize a large number of MPI applications to determine overall applicability, both breadth and type, and so provide insight for hardware designers and MPI developers about future offload possibilities. Besides increasing the scope of prior surveys to include finding (potential) new MPI constructs, we also tap into new methods to extend the survey process. Prior surveys on MPI usage considered lists of applications constructed based on application developers' knowledge. The approach taken in this paper, however, is based on an automated mining of a large collection of code sources. More specifically, the mining is accomplished by GitHub REST APIs. We use a database management system to store the results and to answer queries. Another advantage is that this approach provides support for a more complex analysis of MPI usage, which is accomplished by user queries.

A Source Code Analysis Method with Parallel Acceleration for Mining MPI Application Communication Counts

Parallel Power Flow Algorithm Based on MPI and P-Q Analysis Method

Progress in development of generally applicable method for monitoring parallel software

Analysis of the Practicality of Parallel Communication Algorithms

A Survey of Potential MPI Complex Collectives: Large-Scale Mining and Analysis of HPC Applications

Parallel approach of three-dimensional phase-field model of binary alloy in MPI+OpenMP environment

Communication Analysis And Performance Prediction Of Parallel Applications On Large-Scale Machines

MPISE: Symbolic Execution of MPI Programs.

DataMPI: Extending MPI to Hadoop-Like Big Data Computing

Solution to Codes Scale Reduction of MPI and Implemention

Study on MPI/OpenMP hybrid parallelism for Monte Carlo neutron transport code

The Method of Parallel Optimization and Parallel Recognition Based on Data Dependence

Faster and Scalable MPI Applications Launching

An Efficient Parallel Computing Model On The Smp Cluster

A Parallel Ant Colony Algorithm Based On Mpi For Tsp

Effective method of collective communication for message passing on cluster

MPI Progress For All

MPI Implementation Profiling for Better Application Performance

An iterative clustering based approach for parallel performance analysis

HPC System Software Enhanced by Source Code Analysis

Research and Implementation of Parallel Ant Colony Optimization Algorithm Based on MPI