Abstract:The recent observation of a common red-noise process in pulsar timing arrays (PTAs) suggests that the detection of nanohertz gravitational waves might be around the corner. However, in order to confidently attribute this red process to gravitational waves, one must observe the Hellings-Downs curve -- the telltale angular correlation function associated with a gravitational-wave background. This effort is complicated by the complex modelling of pulsar noise. Without proper care, mis-specified noise models can lead to false-positive detections. Background estimation using bootstrap methods such as sky scrambles and phase shifts, which use the data to characterize the noise, are therefore important tools for assessing significance. We investigate the ability of current PTA experiments to estimate their background with "quasi-independent" scrambles -- characterized by a statistical "match" below the fiducial value: $|M|<0.1$. We show that sky scrambling is affected by "saturation" after $O(10)$ quasi-independent realizations; subsequent scrambles are no longer quasi-independent. We show phase scrambling saturates after $O(100)$ quasi-independent realizations. With so few independent scrambles, it is difficult to make reliable statements about the $\gtrsim 5 \sigma$ tail of the null distribution of the detection statistic. We discuss various methods by which one may increase the number of independent scrambles. We also consider an alternative approach wherein one re-frames the background estimation problem so that the significance is calculated using statistically dependent scrambles. The resulting $p$-value is in principle well-defined but may be susceptible to failure if assumptions about the data are incorrect.

Detecting non-Gaussian gravitational wave backgrounds: a unified framework

Improved detection statistics for non Gaussian gravitational wave stochastic backgrounds

Detection methods for stochastic gravitational-wave backgrounds: a unified treatment

A weakly-parametric approach to stochastic background inference in LISA

Non-Gaussianity test for discriminating gravitational wave backgrounds around 0.1-1Hz

Stochastic Gravitational-Wave Backgrounds: Current Detection Efforts and Future Prospects

Toward a test of Gaussianity of a gravitational wave background

Toward robust detections of nanohertz gravitational waves

Non-Gaussian Statistics of Nanohertz Stochastic Gravitational Waves

Bayesian parameter estimation for targeted anisotropic gravitational-wave background

Gravitational-Wave Geodesy: A New Tool for Validating Detection of the Stochastic Gravitational-Wave Background

Is your stochastic signal really detectable?

How to Detect an Astrophysical Nanohertz Gravitational-Wave Background

Stochastic backgrounds of gravitational waves from extragalactic sources

Geometrical Aspects on Parameter estimation of stochastic gravitational wave background: beyond the Fisher analysis

Searches for stochastic gravitational-wave backgrounds

Non-Gaussianity from the Cross-correlation of the Astrophysical Gravitational Wave Background and the Cosmic Microwave Background

Extension of the characterization method for non-Gaussianity in gravitational wave detector with statistical hypothesis test

Gravitational-Wave Stochastic Background Detection with Resonant-Mass Detectors

Fast Likelihood-free Reconstruction of Gravitational Wave Backgrounds

Stochastic gravitational wave background detection using NANOGrav 15-year data set in the context of massive gravity