Abstract:Pulsar surveys with modern radio telescopes are becoming increasingly computationally demanding. This is particularly true for wide field-of-view pulsar surveys with radio interferometers, and those conducted in real or quasi-real time. These demands result in data analysis bottlenecks that can limit the parameter space covered by the surveys and diminish their scientific return. In this paper, we address the computational challenge of `candidate folding' in pulsar searching, presenting a novel, efficient approach designed to optimise the simultaneous folding of large numbers of pulsar candidates. We provide a complete folding pipeline appropriate for large-scale pulsar surveys including radio frequency interference (RFI) mitigation, dedispersion, folding and parameter optimization. By leveraging the Fast Discrete Dispersion Measure Transform (FDMT) algorithm proposed by Zackay et al. (2017), we have developed an optimized, and cache-friendly implementation that we term the pruned FDMT (pFDMT). The pFDMT approach efficiently reuses intermediate processing results and prunes the unused computation paths, resulting in a significant reduction in arithmetic operations. In addition, we propose a novel folding algorithm based on the Tikhonov-regularised least squares method (TLSM) that can improve the time resolution of the pulsar profile. We present the performance of its real-world application as an integral part of two major pulsar search projects conducted with the MeerKAT telescope: the MPIfR-MeerKAT Galactic Plane Survey (MMGPS) and the Transients and Pulsars with MeerKAT (TRAPUM) project. In our processing, for approximately 500 candidates, the theoretical number of dedispersion operations can be reduced by a factor of around 50 when compared to brute-force dedispersion, which scales with the number of candidates.

Pulsar data analysis with PSRCHIVE

DSPSR: Digital Signal Processing Software for Pulsar Astronomy

Using the Parkes Pulsar Data Archive

The pulsar search collaboratory: Current status and future prospects

The Parkes Observatory Pulsar Data Archive

PRASSE -- The Pulsar Automated Search Script Ensemble

A Data Analysis Library for Gravitational Wave Detection

pulsar_spectra: A pulsar flux density catalogue and spectrum fitting repository

Installation and Use of Pulsar Search Software

Prospects for High-Precision Pulsar Timing with the New Effelsberg PSRIX Backend

The Cdf Archive: Herschel Pacs and Spire Spectroscopic Data Pipeline and Products for Protostars and Young Stellar Objects

The Pulsar Science Collaboratory: Multi-Epoch Scintillation Studies of Pulsars

A Novel Pulsar Profile Extraction Approach for Synchronization Measurement and Its Hardware Implementation

SPARCL: SPectra Analysis and Retrievable Catalog Lab

Polarization measurements of the Crab Pulsar with POLAR

PulsarX: a new pulsar searching package -I. A high performance folding program for pulsar surveys

The Parkes Pulsar Timing Array Project: Second data release

The POSSUM Pipeline: Getting Results from ASKAP Early Science

Artefacts of circumpolar cartography in radio pulsar polarization

Processing System for Coherent Dedispersion of Pulsar Radio Emission

Algorithmic Pulsar Timer for Binaries