Abstract:ExaGRyPE describes a suite of solvers for numerical relativity, based upon ExaHyPE 2, the second generation of our Exascale Hyperbolic PDE Engine. The presented generation of ExaGRyPE solves the Einstein equations in the CCZ4 formulation under a 3+1 foliation and focuses on black hole spacetimes. It employs a block-structured Cartesian grid carrying a higher-order order Finite Difference scheme with adaptive mesh refinement, it facilitates massive parallelism combining message passing, domain decomposition and task parallelism, and it supports the injection of particles into the grid as data probes or tracers. We introduce the ExaGRyPE-specific building blocks within ExaHyPE 2, and discuss its software architecture and compute-n-feel: For this, we formalize the creation of any specific simulation with ExaGRyPE as a sequence of lowering operations, where abstract logical tasks are successively broken into finer tasks until we obtain an abstraction level that can be mapped onto a C++ executable. The overall program logic is fully specified via a domain-specific Python interface, we map this logic onto a more detailed set of numerical tasks, subsequently lower this representation onto technical tasks that the underlying ExaHyPE engine uses to parallelize the application, before eventually the technical tasks are mapped onto task graphs including the actual PDE term evaluations, initial conditions, boundary conditions, and so forth. We end up with a rigorous separation of concerns which shields ExaGRyPE users from technical details and hence simplifies the development of novel physical models. We present the simulations and data for the gauge wave, static single black holes and rotating binary black hole systems, demonstrating that the code base is mature and usable. However, we also uncover domain-specific numerical challenges that need further study by the community in future work.

An Implementation of DF-GHG with Application to Spherical Black Hole Excision

Black Hole Excision for Dynamic Black Holes

Spherical Evolution of the Generalized Harmonic Gauge Formulation of General Relativity on Compactified Hyperboloidal Slices

High-order discontinuous Galerkin schemes with subcell finite volume limiter and adaptive mesh refinement for a monolithic first-order BSSNOK formulation of the Einstein-Euler equations

A Black-Hole Excision Scheme for General Relativistic Core-Collapse Supernova Simulations

A discontinuous Galerkin scheme for elliptic equations on extremely stretched grids

Binary black hole simulation with an adaptive finite element method II: Application of local discontinuous Galerkin method to Einstein equations

Ameliorating the Courant-Friedrichs-Lewy condition in spherical coordinates: A double FFT filter method for general relativistic MHD in dynamical spacetimes

Formulation Improvements for Critical Collapse Simulations

Formulating the complete initial boundary value problem in numerical relativity to model black hole echoes

Discontinuous Galerkin scheme for elliptic equations on extremely stretched grids

A Tetrad-First Approach to Robust Numerical Algorithms in General Relativity

Regularizing Dual-Frame Generalized Harmonic Gauge at Null Infinity

Exploring departures from Schwarzschild black hole in $f(R)$ gravity

Hyperboloidal approach for static spherically symmetric spacetimes: a didactical introduction and applications in black-hole physics

Numerical solutions for the $f(R)$-Klein-Gordon system

Spherically symmetric black hole spacetimes on hyperboloidal slices

Hierarchical data-driven approach to fitting numerical relativity data for nonprecessing binary black holes with an application to final spin and radiated energy

Implementation of a GHZ-Teukolsky puncture scheme for gravitational self-force calculations

ExaGRyPE: Numerical General Relativity Solvers Based upon the Hyperbolic PDEs Solver Engine ExaHyPE

Worldtube excision method for intermediate-mass-ratio inspirals: scalar-field model in 3+1 dimensions