Abstract:Particle advection is one of the foundational algorithms for visualization and analysis and is central to understanding vector fields common to scientific simulations. Achieving efficient performance with large data in a distributed memory setting is notoriously difficult. Because of its simplicity and minimized movement of large vector field data, the Parallelize over Data (POD) algorithm has become a de facto standard. Despite its simplicity and ubiquitous usage, the scaling issues with the POD algorithm are known and have been described throughout the literature. In this paper, we describe a set of in-depth analyses of the POD algorithm that shed new light on the underlying causes for the poor performance of this algorithm. We designed a series of representative workloads to study the performance of the POD algorithm and executed them on a supercomputer while collecting timing and statistical data for analysis. We then performed two different types of analysis. In the first analysis, we introduce two novel metrics for measuring algorithmic efficiency over the course of a workload run. The second analysis was from the perspective of the particles being advected. Using particle centric analysis, we identify that the overheads associated with particle movement between processes (not the communication itself) have a dramatic impact on the overall execution time. In the first analysis, we introduce two novel metrics for measuring algorithmic efficiency over the course of a workload run. The second analysis was from the perspective of the particles being advected. Using particle-centric analysis, we identify that the overheads associated with particle movement between processes have a dramatic impact on the overall execution time. These overheads become particularly costly when flow features span multiple blocks, resulting in repeated particle circulation between blocks.

Enabling High-Throughput Parallel I/O in Particle-in-Cell Monte Carlo Simulations with openPMD and Darshan I/O Monitoring

Understanding the Impact of openPMD on BIT1, a Particle-in-Cell Monte Carlo Code, through Instrumentation, Monitoring, and In-Situ Analysis

Leveraging HPC Profiling & Tracing Tools to Understand the Performance of Particle-in-Cell Monte Carlo Simulations

Optimizing BIT1, a Particle-in-Cell Monte Carlo Code, with OpenMP/OpenACC and GPU Acceleration

Parallelized Implementation of the Finite Particle Method for Explicit Dynamics in GPU

Parallelization and I/O Optimization for a 3-D Plasma Simulation Code

Characterizing the Performance of the Implicit Massively Parallel Particle-in-Cell iPIC3D Code

Exploiting Parallelism on Shared Memory in the QED Particle-in-Cell Code PICADOR with Greedy Load Balancing

The Plasma Simulation Code: A modern particle-in-cell code with load-balancing and GPU support

VPIC 2.0: Next Generation Particle-in-Cell Simulations

Parallel 3D Deterministic Particle Transport on Intel MIC Architecture

Understanding Large-Scale Plasma Simulation Challenges for Fusion Energy on Supercomputers

ParallelDualSPHysics: Supporting Efficient Parallel Fluid Simulations Through MPI-enabled SPH Method

Parallelization and Optimization of Laser-Plasma-Interaction Simulation

Parallelize Over Data Particle Advection: Participation, Ping Pong Particles, and Overhead

Performance Portable Monte Carlo Particle Transport on Intel, NVIDIA, and AMD GPUs

Pushing Back the Limit of Ab-initio Quantum Transport Simulations on Hybrid Supercomputers

Accelerating Molecular Dynamics Simulations Using Socket-Based Inter-Process Communication

Recent Results and Future Challenges for Large Scale Particle-in-cell Simulations of Plasma-Based Accelerator Concepts

PM2D: A Parallel GPU-based Code for the Kinetic Simulation of Laser Plasma Instabilities at Large Scales

Modern Gyrokinetic Particle-In-Cell Simulation of Fusion Plasmas on Top Supercomputers