Abstract:The recent observation of a common red-noise process in pulsar timing arrays (PTAs) suggests that the detection of nanohertz gravitational waves might be around the corner. However, in order to confidently attribute this red process to gravitational waves, one must observe the Hellings-Downs curve -- the telltale angular correlation function associated with a gravitational-wave background. This effort is complicated by the complex modelling of pulsar noise. Without proper care, mis-specified noise models can lead to false-positive detections. Background estimation using bootstrap methods such as sky scrambles and phase shifts, which use the data to characterize the noise, are therefore important tools for assessing significance. We investigate the ability of current PTA experiments to estimate their background with "quasi-independent" scrambles -- characterized by a statistical "match" below the fiducial value: $|M|<0.1$. We show that sky scrambling is affected by "saturation" after $O(10)$ quasi-independent realizations; subsequent scrambles are no longer quasi-independent. We show phase scrambling saturates after $O(100)$ quasi-independent realizations. With so few independent scrambles, it is difficult to make reliable statements about the $\gtrsim 5 \sigma$ tail of the null distribution of the detection statistic. We discuss various methods by which one may increase the number of independent scrambles. We also consider an alternative approach wherein one re-frames the background estimation problem so that the significance is calculated using statistically dependent scrambles. The resulting $p$-value is in principle well-defined but may be susceptible to failure if assumptions about the data are incorrect.

Posterior predictive checking for gravitational-wave detection with pulsar timing arrays: I. The optimal statistic

Posterior predictive checking for gravitational-wave detection with pulsar timing arrays: II. Posterior predictive distributions and pseudo Bayes factors

The NANOGrav 15 yr data set: Posterior predictive checks for gravitational-wave detection with pulsar timing arrays

Model Dependence of Bayesian Gravitational-wave Background Statistics for Pulsar Timing Arrays

Toward robust detections of nanohertz gravitational waves

On the (In)Efficiency of the Cross-Correlation Statistic for Gravitational Wave Stochastic Background Signals with Non-Gaussian Noise and Heterogeneous Detector Sensitivities

Accurate pulsar timing array residual variances and correlation of the stochastic gravitational wave background

Modeling nonstationary noise in pulsar timing array data analysis

Pulsar and cosmic variances of pulsar timing-array correlation measurements of the stochastic gravitational wave background

Optimal Strategies for Gravitational Wave Memory Detection in Pulsar Timing Arrays

Systematic errors in searches for nanohertz gravitational waves

Testing gravity with cosmic variance-limited pulsar timing array correlations

Analytic distribution of the optimal cross-correlation statistic for stochastic gravitational-wave-background searches using pulsar timing arrays

Forecasting pulsar timing array sensitivity to anisotropy in the stochastic gravitational wave background

Minimum Requirements for Detecting a Stochastic Gravitational Wave Background Using Pulsars

Efficient Bayesian inference and model selection for continuous gravitational waves in pulsar timing array data

Modeling non stationary noise in pulsar timing array data analysis

Bayesian $\mathcal{F}$-statistic-based parameter estimation of continuous gravitational waves from known pulsars

A Bayesian parameter estimation approach to pulsar time-of-arrival analysis