Abstract:Direct Numerical Simulations (DNS) of the Navier Stokes equations is an invaluable research tool in fluid dynamics. Still, there are few publicly available research codes and, due to the heavy number crunching implied, available codes are usually written in low-level languages such as C/C++ or Fortran. In this paper we describe a pure scientific Python pseudo-spectral DNS code that nearly matches the performance of C++ for thousands of processors and billions of unknowns. We also describe a version optimized through Cython, that is found to match the speed of C++. The solvers are written from scratch in Python, both the mesh, the MPI domain decomposition, and the temporal integrators. The solvers have been verified and benchmarked on the Shaheen supercomputer at the KAUST supercomputing laboratory, and we are able to show very good scaling up to several thousand cores. A very important part of the implementation is the mesh decomposition (we implement both slab and pencil decompositions) and 3D parallel Fast Fourier Transforms (FFT). The mesh decomposition and FFT routines have been implemented in Python using serial FFT routines (either NumPy, pyFFTW or any other serial FFT module), NumPy array manipulations and with MPI communications handled by MPI for Python (mpi4py). We show how we are able to execute a 3D parallel FFT in Python for a slab mesh decomposition using 4 lines of compact Python code, for which the parallel performance on Shaheen is found to be slightly better than similar routines provided through the FFTW library. For a pencil mesh decomposition 7 lines of code is required to execute a transform.

Performance of Python runtimes on a non-numeric scientific code

Performance Evaluation of Python Parallel Programming Models: Charm4Py and mpi4py

Productivity, Portability, Performance: Data-Centric Python

Evaluating performance and portability of high-level programming models: Julia, Python/Numba, and Kokkos on exascale nodes

OMP4Py: a pure Python implementation of OpenMP

Quantifying the Interpretation Overhead of Python

High performance Python for direct numerical simulations of turbulent flows

Numerical Performance and Throughput Benchmark for Electronic Structure Calculations in Pc-Linux Systems with New Architectures, Updated Compilers, and Libraries

Does Coding in Pythonic Zen Peak Performance? Preliminary Experiments of Nine Pythonic Idioms at Scale

Exploring and Benchmarking High Performance & Scientific Computing using R R HPC Packages and Lower level compiled languages A Comparative Study

Faster or Slower? Performance Mystery of Python Idioms Unveiled with Empirical Evidence

Performance on HPC Platforms Is Possible Without C++

A Python Benchmark Functions Framework for Numerical Optimisation Problems

Simplifying Parallelization of Scientific Codes by a Function-Centric Approach in Python

Function call overhead benchmarks with MATLAB, Octave, Python, Cython and C

Rewrite it in Rust: A Computational Physics Case Study

Asynchronous Execution of Python Code on Task Based Runtime Systems

How fast can we make interpreted Python?

OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems

The ELAPS Framework: Experimental Linear Algebra Performance Studies

Providing performance portable numerics for Intel GPUs