Abstract:We investigate the issue in determining the significance of candidate transient gravitational-wave events in a ground-based interferometer network. Given the presence of non-Gaussian noise artefacts in real data, the noise background must be estimated empirically from the data itself. However, the data also potentially contains signals, thus the background estimate may be overstated due to contributions from signals. It has been proposed to mitigate possible bias by removing single-detector data samples that pass a multi-detector consistency test from the background estimates. We conduct a high-statistics Mock Data Challenge to evaluate the effects of removing such samples, modelling a range of scenarios with plausible detector noise distributions and with a range of plausible foreground astrophysical signal rates. We consider the two different modes: one in which coincident samples are removed, and one in which all samples are retained and used. Three algorithms were operated in both modes, show good consistency with each other; however, discrepancies arise between the results obtained under the "coincidence removal" and "all samples" modes, for false alarm probabilities below a certain value. In most scenarios the median of the false alarm probability (FAP) estimator under the "all samples" mode is consistent with the exact FAP. On the other hand the "coincidence removal" mode is found to be unbiased for the mean of the estimated FAP. While the numerical values at which discrepancies become apparent are specific to the details of our experiment, we believe that the qualitative differences in the behaviour of the median and mean of the FAP estimator have more general validity. On the basis of our study we suggest that the FAP of candidates for the first detection of gravitational waves should be estimated without removing single-detector samples that form coincidences.

False-alarm probability in relation to over-sampled power spectra, with application to Super-Kamiokande solar neutrino data

Review of Methods of Power-Spectrum Analysis as Applied to Super-Kamiokande Solar Neutrino Data

The correct estimate of the probability of false detection of the matched filter in the detection of weak signals. II. (Further results with application to a set of ALMA and ATCA data)

False Alarm Rate based Statistical Detection Limit for Astronomical Photon Detectors

Gravitational-wave geodesy: Defining false alarm probabilities with respect to correlated noise

Systematic errors in estimation of gravitational-wave candidate significance

A Relationship Between the False Alarm Probability and the Atomic Norm Denoising Regularization Parameter for Line Spectral Estimation

A Statistical Primer on Classical Period-Finding Techniques in Astronomy

Bayesian power spectral estimation of gravitational wave detector noise revisited

Posterior predictive checking for gravitational-wave detection with pulsar timing arrays: I. The optimal statistic

Generalized Lomb–Scargle analysis of 22 years of super-Kamiokande solar B neutrino data

First detailed calculation of atmospheric neutrino foregrounds to the diffuse supernova neutrino background in Super-Kamiokande

Periodogram and likelihood periodicity search in the SNO solar neutrino data

The Significance of an Excess in a Counting Experiment: Assessing the Impact of Systematic Uncertainties and the Case with a Gaussian Background

An Oscillation Evident in Both Solar Neutrino Data and Radon Decay Data

Generalized Lomb-Scargle Analysis of 22 years of Super-Kamiokande solar $^8$B neutrino data

Periodicity significance testing with null-signal templates: reassessment of PTF's SMBH binary candidates

Bayesian Inference of Supernova Neutrino Spectra with Multiple Detectors