Abstract:This paper explores practical aspects of using a high-level functional language for GPU-based arithmetic on ``midsize'' integers. By this we mean integers of up to about a quarter million bits, which is sufficient for most practical purposes. The goal is to understand whether it is possible to support efficient nested-parallel programs with a small, flexible code base. We report on GPU implementations for addition and multiplication of integers that fit in one CUDA block, thus leveraging temporal reuse from scratchpad memories. Our key contribution resides in the simplicity of the proposed solutions: We recognize that addition is a straightforward application of scan, which is known to allow efficient GPU implementation. For quadratic multiplication we employ a simple work-partitioning strategy that offers good temporal locality. For FFT multiplication, we efficiently map the computation in the domain of integral fields by finding ``good'' primes that enable almost-full utilization of machine words. In comparison, related work uses complex tiling strategies -- which feel too big a hammer for the job -- or uses the computational domain of reals, which may degrade the magnitude of the base in which the computation is carried. We evaluate the performance in comparison to the state-of-the-art CGBN library, authored by NvidiaLab, and report that our CUDA prototype outperforms CGBN for integer sizes higher than 32K bits, while offering comparable performance for smaller sizes. Moreover, we are, to our knowledge, the first to report that FFT multiplication outperforms the classical one on the larger sizes that still fit in a CUDA block. Finally, we examine Futhark's strengths and weaknesses for efficiently supporting such computations and find out that a compiler pass aimed at efficient sequentialization of excess parallelism would significantly improve performance.

LeXInt: GPU-accelerated Exponential Integrators package

LeXInt: Package for Exponential Integrators employing Leja interpolation

Efficiently and easily integrating differential equations with JiTCODE, JiTCDDE, and JiTCSDE

NLSEmagic: Nonlinear Schrödinger Equation Multidimensional Matlab-based GPU-accelerated Integrators using Compact High-order Schemes

Finite Element Integration with Quadrature on the GPU

Low-synchronization Arnoldi Methods for the Matrix Exponential with Application to Exponential Integrators

Leveraging Mixed Precision in Exponential Time Integration Methods

Efficient third order tensor-oriented directional splitting for exponential integrators

KIOPS: A fast adaptive Krylov subspace solver for exponential integrators

Should exponential integrators be used for advection-dominated problems?

EPIRK-W and EPIRK-K time discretization methods

Full- and low-rank exponential Euler integrators for the Lindblad equation

Exponential Integrators for Phase-Field Equations using Pseudo-spectral Methods: A Python Implementation

Efficient Exponential Integrator Finite Element Method for Semilinear Parabolic Equations

GPU Implementations for Midsize Integer Addition and Multiplication

Explicit integrators for nonlocal equations: The case of the Maxey-Riley-Gatignol equation

Geometric Exponential Integrators

An investigation of GPU-based stiff chemical kinetics integration methods

Exasim: Generating Discontinuous Galerkin Codes for Numerical Solutions of Partial Differential Equations on Graphics Processors

Semi-analytical Exponential RKN Integrators for Efficiently Solving High-Dimensional Nonlinear Wave Equations Based on FFT Techniques.

Parallel-in-time high-order multiderivative IMEX solvers