Abstract:Pulsar surveys with modern radio telescopes are becoming increasingly computationally demanding. This is particularly true for wide field-of-view pulsar surveys with radio interferometers, and those conducted in real or quasi-real time. These demands result in data analysis bottlenecks that can limit the parameter space covered by the surveys and diminish their scientific return. In this paper, we address the computational challenge of `candidate folding' in pulsar searching, presenting a novel, efficient approach designed to optimise the simultaneous folding of large numbers of pulsar candidates. We provide a complete folding pipeline appropriate for large-scale pulsar surveys including radio frequency interference (RFI) mitigation, dedispersion, folding and parameter optimization. By leveraging the Fast Discrete Dispersion Measure Transform (FDMT) algorithm proposed by Zackay et al. (2017), we have developed an optimized, and cache-friendly implementation that we term the pruned FDMT (pFDMT). The pFDMT approach efficiently reuses intermediate processing results and prunes the unused computation paths, resulting in a significant reduction in arithmetic operations. In addition, we propose a novel folding algorithm based on the Tikhonov-regularised least squares method (TLSM) that can improve the time resolution of the pulsar profile. We present the performance of its real-world application as an integral part of two major pulsar search projects conducted with the MeerKAT telescope: the MPIfR-MeerKAT Galactic Plane Survey (MMGPS) and the Transients and Pulsars with MeerKAT (TRAPUM) project. In our processing, for approximately 500 candidates, the theoretical number of dedispersion operations can be reduced by a factor of around 50 when compared to brute-force dedispersion, which scales with the number of candidates.

Pruning: a tool to optimize the layout of large scale arrays for ultra-high-energy air-shower detection

Pruning: a tool to optimize the layout of large scale arrays for ultra-high-energy air-shower detection

Layout optimization and Performance of Large Array of imaging atmospheric Cherenkov Telescope (LACT)

A Systematic Assessment of Data Volume Reduction for IACTs

Design of Low-Complexity 3-D Underwater Imaging System with Sparse Planar Arrays

Radio wavefront of very inclined extensive air-showers: a simulation study for extended and sparse radio arrays

A Simple Parallelization Scheme for Extensive Air Shower Simulations

Analytical planar wavefront reconstruction and error estimates for radio detection of extensive air showers

Muons as a tool for background rejection in imaging atmospheric Cherenkov telescope arrays

A high-precision interpolation method for pulsed radio signals from cosmic-ray air showers

PulsarX: a new pulsar searching package -I. A high performance folding program for pulsar surveys

Discarded low energy particles in extensive air shower simulations: Effect on the shower Energy Deposit

Analytic calculation of radio emission from parameterized extensive air showers, a tool to extract shower parameters

Radio Morphing: towards a fast computation of the radio signal from air showers

A Novel Tiling Technique Via an Evolutionary Strategy for Large-Scale Irregular Arrays

3D Small Object Detection with Dynamic Spatial Pruning

Targeting 100-PeV tau neutrino detection with an array of phased and high-gain reconstruction antennas

Optimization Design of Sparse Arrays for Phased-Array 3D Imaging Sonar Systems

A Water Tank Cerenkov Detector for Very High Energy Astroparticles

Omniscopes: Large Area Telescope Arrays with only N log N Computational Cost

EASpy: Fast simulation of fluorescence and Cherenkov light from extended air showers at large zenith angles